Regret Minimizing Bayesian Persuasion. We study a Bayesian persuasion setting with binary actions (adopt and reject) for Receiver. We examine the following question how well can Sender perform, in terms of persuading Receiver to adopt, when ignorant of Receiver's utility? We take a robust (adversarial) approach to study this problem that is, our goal is to design signaling schemes for Sender that perform well for all possible Receiver's utilities. We measure performance of signaling schemes via the notion of (additive) regret the difference between Sender's hypothetically optimal utility had she known Receiver's utility function and her actual utility induced by the given scheme. On the negative side, we show that if Sender has no knowledge at all about Receiver's utility, then Sender has no signaling scheme that performs robustly well. On the positive side, we show that if Sender only knows Receiver's ordinal preferences of the states of nature i.e., Receiver's utility upon adoption is monotonic as a function of the state then Sender can guarantee a surprisingly low regret even when the number of states tends to infinity. In fact, we exactly pin down the minimum regret value that Sender can guarantee in this case, which turns out to be at most 1 e. We further show that such positive results are not possible under the alternative performance measure of a multiplicative approximation ratio by proving that no constant ratio can be guaranteed even for monotonic Receiver's utility this may serve to demonstrate the merits of regret as a robust performance measure that is not too pessimistic. Finally, we analyze an intermediate setting in between the no knowledge and the ordinal knowledge settings.


Answer Set Programming Made Easy. We take up an idea from the folklore of Answer Set Programming, namely that choices, integrity constraints along with a restricted rule format is sufficient for Answer Set Programming. We elaborate upon the foundations of this idea in the context of the logic of Here and There and show how it can be derived from the logical principle of extension by definition. We then provide an austere form of logic programs that may serve as a normalform for logic programs similar to conjunctive normalform in classical logic. Finally, we take the key ideas and propose a modeling methodology for ASP beginners and illustrate how it can be used.


Review of Face Presentation Attack Detection Competitions. Face presentation attack detection (PAD) has received increasing attention ever since the vulnerabilities to spoofing have been widely recognized. The state of the art in unimodal and multi modal face anti spoofing has been assessed in eight international competitions organized in conjunction with major biometrics and computer vision conferences in 2011, 2013, 2017, 2019, 2020 and 2021, each introducing new challenges to the research community. In this chapter, we present the design and results of the five latest competitions from 2019 until 2021. The first two challenges aimed to evaluate the effectiveness of face PAD in multi modal setup introducing near infrared (NIR) and depth modalities in addition to colour camera data, while the latest three competitions focused on evaluating domain and attack type generalization abilities of face PAD algorithms operating on conventional colour images and videos. We also discuss the lessons learnt from the competitions and future challenges in the field in general.


Multi Head Self Attention via Vision Transformer for Zero Shot Learning. Zero Shot Learning (ZSL) aims to recognise unseen object classes, which are not observed during the training phase. The existing body of works on ZSL mostly relies on pretrained visual features and lacks the explicit attribute localisation mechanism on images. In this work, we propose an attention based model in the problem settings of ZSL to learn attributes useful for unseen class recognition. Our method uses an attention mechanism adapted from Vision Transformer to capture and learn discriminative attributes by splitting images into small patches. We conduct experiments on three popular ZSL benchmarks (i.e., AWA2, CUB and SUN) and set new state of the art harmonic mean results on all the three datasets , which illustrate the effectiveness of our proposed method.


PageRank Asymptotics on Directed Preferential Attachment Networks. We characterize the tail behavior of the distribution of the PageRank of a uniformly chosen vertex in a directed preferential attachment graph and show that it decays as a power law with an explicit exponent that is described in terms of the model parameters. Interestingly, this power law is heavier than the tail of the limiting in degree distribution, which goes against the commonly accepted em power law hypothesis . This deviation from the power law hypothesis points at the structural differences between the inbound neighborhoods of typical vertices in a preferential attachment graph versus those in static random graph models where the power law hypothesis has been proven to hold (e.g., directed configuration models and inhomogeneous random digraphs). In addition to characterizing the PageRank distribution of a typical vertex, we also characterize the explicit growth rate of the PageRank of the oldest vertex as the network size grows.


Design of AoI Aware 5G Uplink Scheduler UsingReinforcement Learning. Age of Information (AoI) reflects the time that is elapsed from the generation of a packet by a 5G user equipment(UE) to the reception of the packet by a controller. A design of an AoI aware radio resource scheduler for UEs via reinforcement learning is proposed in this paper. In this paper, we consider a remote control environment in which a number of UEs are transmitting time sensitive measurements to a remote controller. We consider the AoI minimization problem and formulate the problem as a trade off between minimizing the sum of the expected AoI of all UEs and maximizing the throughput of the network. Inspired by the success of machine learning in solving large networking problems at low complexity, we develop a reinforcement learning based method to solve the formulated problem. We used the state of the art proximal policy optimization algorithm to solve this problem. Our simulation results showthat the proposed algorithm outperforms the considered baselines in terms of minimizing the expected AoI while maintaining the network throughput.


Partial Domain Adaptation without Domain Alignment. Unsupervised domain adaptation (UDA) aims to transfer knowledge from a well labeled source domain to a different but related unlabeled target domain with identical label space. Currently, the main workhorse for solving UDA is domain alignment, which has proven successful. However, it is often difficult to find an appropriate source domain with identical label space. A more practical scenario is so called partial domain adaptation (PDA) in which the source label set or space subsumes the target one. Unfortunately, in PDA, due to the existence of the irrelevant categories in the source domain, it is quite hard to obtain a perfect alignment, thus resulting in mode collapse and negative transfer. Although several efforts have been made by down weighting the irrelevant source categories, the strategies used tend to be burdensome and risky since exactly which irrelevant categories are unknown. These challenges motivate us to find a relatively simpler alternative to solve PDA. To achieve this, we first provide a thorough theoretical analysis, which illustrates that the target risk is bounded by both model smoothness and between domain discrepancy. Considering the difficulty of perfect alignment in solving PDA, we turn to focus on the model smoothness while discard the riskier domain alignment to enhance the adaptability of the model. Specifically, we instantiate the model smoothness as a quite simple intra domain structure preserving (IDSP). To our best knowledge, this is the first naive attempt to address the PDA without domain alignment. Finally, our empirical results on multiple benchmark datasets demonstrate that IDSP is not only superior to the PDA SOTAs by a significant margin on some benchmarks (e.g., 10 on Cl Rw and 8 on Ar Rw ), but also complementary to domain alignment in the standard UDA


POI Alias Discovery in Delivery Addresses using User Locations. People often refer to a place of interest (POI) by an alias. In e commerce scenarios, the POI alias problem affects the quality of the delivery address of online orders, bringing substantial challenges to intelligent logistics systems and market decision making. Labeling the aliases of POIs involves heavy human labor, which is inefficient and expensive. Inspired by the observation that the users' GPS locations are highly related to their delivery address, we propose a ubiquitous alias discovery framework. Firstly, for each POI name in delivery addresses, the location data of its associated users, namely Mobility Profile are extracted. Then, we identify the alias relationship by modeling the similarity of mobility profiles. Comprehensive experiments on the large scale location data and delivery address data from JD logistics validate the effectiveness.


InfoVAEGAN learning joint interpretable representations by information maximization and maximum likelihood. Learning disentangled and interpretable representations is an important step towards accomplishing comprehensive data representations on the manifold. In this paper, we propose a novel representation learning algorithm which combines the inference abilities of Variational Autoencoders (VAE) with the generalization capability of Generative Adversarial Networks (GAN). The proposed model, called InfoVAEGAN, consists of three networks Encoder, Generator and Discriminator. InfoVAEGAN aims to jointly learn discrete and continuous interpretable representations in an unsupervised manner by using two different data free log likelihood functions onto the variables sampled from the generator's distribution. We propose a two stage algorithm for optimizing the inference network separately from the generator training. Moreover, we enforce the learning of interpretable representations through the maximization of the mutual information between the existing latent variables and those created through generative and inference processes.


An efficient 146 line 3D sensitivity analysis code of stress based topology optimization written in MATLAB. This paper presents an efficient and compact MATLAB code for three dimensional stress based sensitivity analysis. The 146 lines code includes the finite element analysis and p norm stress sensitivity analysis based on the adjoint method. The 3D sensitivity analysis for p norm global stress measure is derived and explained in detail accompanied by corresponding MATLAB code. The correctness of the analytical sensitivity is verified by comparison with finite difference approximation. The nonlinear optimization solver is chosen as the Method of moving asymptotes (MMA). Three typical volume constrained stress minimization problems are presented to verify the effectiveness of sensitivity analysis code. The MATLAB code presented in this paper can be extended to resolve different stress related 3D topology optimization problems. The complete program for sensitivity analysis is given in the Appendix and is intended for educational purposes only.


Lifelong Computing. Computing systems form the backbone of many aspects of our life, hence they are becoming as vital as water, electricity, and road infrastructures for our society. Yet, engineering long running computing systems that achieve their goals in ever changing environments pose significant challenges. Currently, we can build computing systems that adjust or learn over time to match changes that were anticipated. However, dealing with unanticipated changes, such as anomalies, novelties, new goals or constraints, requires system evolution, which remains in essence a human driven activity. Given the growing complexity of computing systems and the vast amount of highly complex data to process, this approach will eventually become unmanageable. To break through the status quo, we put forward a new paradigm for the design and operation of computing systems that we coin "lifelong computing." The paradigm starts from computing learning systems that integrate computing service modules and learning modules. Computing warehouses offer such computing elements together with data sheets and usage guides. When detecting anomalies, novelties, new goals or constraints, a lifelong computing system activates an evolutionary self learning engine that runs online experiments to determine how the computing learning system needs to evolve to deal with the changes, thereby changing its architecture and integrating new computing elements from computing warehouses as needed. Depending on the domain at hand, some activities of lifelong computing systems can be supported by humans. We motivate the need for lifelong computing with a future fish farming scenario, outline a blueprint architecture for lifelong computing systems, and highlight key research challenges to realise the vision of lifelong computing.


C algebras where every element is a limit of products of positive elements. We obtain a characterization of the unital C algebras with the property that every element is a limit of products of positive elements, thereby answering a question of Murphy and Phillips.


Distributionally robust portfolio maximisation and marginal utility pricing in one period financial markets. We consider the optimal investment and marginal utility pricing problem of a risk averse agent and quantify their exposure to a small amount of model uncertainty. Specifically, we compute explicitly the first order sensitivity of their value function, optimal investment policy and marginal option prices to model uncertainty. The latter is understood as replacing a baseline model mathbb P with an adverse choice from a small Wasserstein ball around mathbb P in the space of probability measures. Our sensitivities are thus fully non parametric. We show that the results entangle the baseline model specification and the agent's risk attitudes. The sensitivities can behave in a non monotone way as a function of the baseline model's Sharpe's ratio, the relative weighting of assets in an agent's portfolio can change and marginal prices can increase when an agent faces model uncertainty.


Algorithms Using Local Graph Features to Predict Epidemics. We study a simple model of epidemics where an infected node transmits the infection to its neighbors independently with probability p . This is also known as the independent cascade or Susceptible Infected Recovered (SIR) model with fixed recovery time. The size of an outbreak in this model is closely related to that of the giant connected component in edge percolation'', where each edge of the graph is kept independently with probability p , studied for a large class of networks including configuration model cite molloy2011critical and preferential attachment cite bollobas2003,Riordan2005 . Even though these models capture the effects of degree inhomogeneity and the role of super spreaders in the spread of an epidemic, they only consider graphs that are locally tree like i.e. have a few or no short cycles. Some generalizations of the configuration model were suggested to capture local communities, known as household models cite ball2009threshold , or hierarchical configuration model cite Hofstad2015hierarchical . Here, we ask a different question what information is needed for general networks to predict the size of an outbreak? Is it possible to make predictions by accessing the distribution of small subgraphs (or motifs)? We answer the question in the affirmative for large set expanders with local weak limits (also known as Benjamini Schramm limits). In particular, we show that there is an algorithm which gives a (1 epsilon) approximation of the probability and the final size of an outbreak by accessing a constant size neighborhood of a constant number of nodes chosen uniformly at random. We also present corollaries of the theorem for the preferential attachment model, and study generalizations with household (or motif) structure. The latter was only known for the configuration model.


"Excavating AI" Re excavated Debunking a Fallacious Account of the JAFFE Dataset. Twenty five years ago, my colleagues Miyuki Kamachi and Jiro Gyoba and I designed and photographed JAFFE, a set of facial expression images intended for use in a study of face perception. In 2019, without seeking permission or informing us, Kate Crawford and Trevor Paglen exhibited JAFFE in two widely publicized art shows. In addition, they published a nonfactual account of the images in the essay "Excavating AI The Politics of Images in Machine Learning Training Sets." The present article recounts the creation of the JAFFE dataset and unravels each of Crawford and Paglen's fallacious statements. I also discuss JAFFE more broadly in connection with research on facial expression, affective computing, and human computer interaction.


Event Flow How Events Shaped the Flow of the News, 1950 1995. This article relies on information theoretic measures to examine how events impacted the news for the period 1950 1995. Moreover, we present a method for event characterization in (unstructured) textual sources, offering a taxonomy of events based on the different ways they impacted the flow of news information. The results give us a better understanding of the relationship between events and their impact on news sources with varying ideological backgrounds.


Learning to Break Deep Perceptual Hashing The Use Case NeuralHash. Apple recently revealed its deep perceptual hashing system NeuralHash to detect child sexual abuse material (CSAM) on user devices before files are uploaded to its iCloud service. Public criticism quickly arose regarding the protection of user privacy and the system's reliability. In this paper, we present the first comprehensive empirical analysis of deep perceptual hashing based on NeuralHash. Specifically, we show that current deep perceptual hashing may not be robust. An adversary can manipulate the hash values by applying slight changes in images, either induced by gradient based approaches or simply by performing standard image transformations, forcing or preventing hash collisions. Such attacks permit malicious actors easily to exploit the detection system from hiding abusive material to framing innocent users, everything is possible. Moreover, using the hash values, inferences can still be made about the data stored on user devices. In our view, based on our results, deep perceptual hashing in its current form is generally not ready for robust client side scanning and should not be used from a privacy perspective.


Successive Convex Approximation Based Off Policy Optimization for Constrained Reinforcement Learning. We propose a successive convex approximation based off policy optimization (SCAOPO) algorithm to solve the general constrained reinforcement learning problem, which is formulated as a constrained Markov decision process (CMDP) in the context of average cost. The SCAOPO is based on solving a sequence of convex objective feasibility optimization problems obtained by replacing the objective and constraint functions in the original problems with convex surrogate functions. At each iteration, the convex surrogate problem can be efficiently solved by Lagrange dual method even the policy is parameterized by a high dimensional function. Moreover, the SCAOPO enables to reuse old experiences from previous updates, thereby significantly reducing the implementation cost when deployed in the real world engineering systems that need to online learn the environment. In spite of the time varying state distribution and the stochastic bias incurred by the off policy learning, the SCAOPO with a feasible initial point can still provably converge to a Karush Kuhn Tucker (KKT) point of the original problem almost surely.


Crowdsourcing based Multi Device Communication Cooperation for Mobile High Quality Video Enhancement. The widespread use of mobile devices propels the development of new fashioned video applications like 3D (3 Dimensional) stereo video and mobile cloud game via web or App, exerting more pressure on current mobile access network. To address this challenge, we adopt the crowdsourcing paradigm to offer some incentive for guiding the movement of recruited crowdsourcing users and facilitate the optimization of the movement control decision. In this paper, based on a practical 4G (4th Generation) network throughput measurement study, we formulate the movement control decision as a cost constrained user recruitment optimization problem. Considering the intractable complexity of this problem, we focus first on a single crowdsourcing user case and propose a pseudo polynomial time complexity optimal solution. Then, we apply this solution to solve the more general problem of multiple users and propose a graph partition based algorithm. Extensive experiments show that our solutions can improve the efficiency of real time D2D communication for mobile videos.


On Training Implicit Models. This paper focuses on training implicit models of infinite layers. Specifically, previous works employ implicit differentiation and solve the exact gradient for the backward propagation. However, is it necessary to compute such an exact but expensive gradient for training? In this work, we propose a novel gradient estimate for implicit models, named phantom gradient, that 1) forgoes the costly computation of the exact gradient and 2) provides an update direction empirically preferable to the implicit model training. We theoretically analyze the condition under which an ascent direction of the loss landscape could be found, and provide two specific instantiations of the phantom gradient based on the damped unrolling and Neumann series. Experiments on large scale tasks demonstrate that these lightweight phantom gradients significantly accelerate the backward passes in training implicit models by roughly 1.7 times, and even boost the performance over approaches based on the exact gradient on ImageNet.


Virtual posets, shuffle algebras and associators. We provide a method to construct new associators out of Drinfel'd's KZ associator. We obtain two analytic families of associators whose coefficients we can describe explicitly by a generalization of multiple zeta values. The two families contain two different paths that deform the Drinfel'd KZ associator into the trivial associator 1. We show that both paths are injective, that is, all of the associators parametrized by them are different. Our construction is based on the observation that one can recover multiple polylogarithms as generating functions of order polynomials of certain formally constructed posets.


End to End Delay Guaranteed SFC Deployment A Multi level Mapping Approach. Network Function Virtualization (NFV) enables service providers to maximize the business profit via resource efficient QoS provisioning for customer requested Service Function Chains (SFCs). In recent applications, end to end delay is one of the crucial QoS requirement needs to be guaranteed in SFC deployment. While it is considered in the literature, accurate and comprehensive modeling of the delay in the problem of maximizing the service provider's profit has not yet been addressed. In this paper, at first, the problem is formulated as a mixed integer convex programming model. Then, by decomposing the model, a two level mapping algorithm is developed, that at the first level, maps the functions of the SFCs to virtual network function instances and in the second level, deploys the instances in the physical network. Simulation results show that the proposed approach achieves a near optimal solution in comparison the performance bound obtained by the optimization model, and also superiors the existing solutions.


Learning to Navigate Sidewalks in Outdoor Environments. Outdoor navigation on sidewalks in urban environments is the key technology behind important human assistive applications, such as last mile delivery or neighborhood patrol. This paper aims to develop a quadruped robot that follows a route plan generated by public map services, while remaining on sidewalks and avoiding collisions with obstacles and pedestrians. We devise a two staged learning framework, which first trains a teacher agent in an abstract world with privileged ground truth information, and then applies Behavior Cloning to teach the skills to a student agent who only has access to realistic sensors. The main research effort of this paper focuses on overcoming challenges when deploying the student policy on a quadruped robot in the real world. We propose methodologies for designing sensing modalities, network architectures, and training procedures to enable zero shot policy transfer to unstructured and dynamic real outdoor environments. We evaluate our learning framework on a quadrupedal robot navigating sidewalks in the city of Atlanta, USA. Using the learned navigation policy and its onboard sensors, the robot is able to walk 3.2 kilometers with a limited number of human interventions.


Polarize, Catalyze, Stabilize Conscience and the evolution of cooperation. Much of the literature on the evolution of cooperation focuses on mechanisms such as reciprocity, indirect reciprocity, and altruistic punishment, all of which require group knowledge of individual actions. But what keeps people cooperating when no one is looking? Conscience, an internal enforcer of cooperation, could be the answer. In this paper, we model conscience as the internalization of societal norms individuals with conscience internalize a tendency to cooperate in a public goods game, as long as the majority of their community does the same (regardless of whether anyone is watching). Using two very different agent based models, we demonstrate the evolutionary viability of this rudimentary conscience and its contribution to the evolution of cooperation. In both models, conscience was evolutionarily viable under reasonable group selective forces. Furthermore, conscience affected the dynamics of cooperation in three ways. First, conscience polarized communities groups with a high prevalence of conscience gravitated either to near full cooperation or to near zero cooperation. Second, conscience catalyzed cooperation its tendency to polarize magnified differences between groups, thereby facilitating the group level selection in favor of cooperative groups. Third, in one of the models, conscience stabilized cooperation the prevalence of conscience tended to decrease when cooperation was high and increase when cooperation was low, thereby dampening fluctuations in the level of cooperation.


Defending Touch based Continuous Authentication Systems from Active Adversaries Using Generative Adversarial Networks. Previous studies have demonstrated that commonly studied (vanilla) touch based continuous authentication systems (V TCAS) are susceptible to population attack. This paper proposes a novel Generative Adversarial Network assisted TCAS (G TCAS) framework, which showed more resilience to the population attack. G TCAS framework was tested on a dataset of 117 users who interacted with a smartphone and tablet pair. On average, the increase in the false accept rates (FARs) for V TCAS was much higher (22 ) than G TCAS (13 ) for the smartphone. Likewise, the increase in the FARs for V TCAS was 25 compared to G TCAS (6 ) for the tablet.


Risk Aware Path Planning for Ground Vehicles using Occluded Aerial Images. We consider scenarios where a ground vehicle plans its path using data gathered by an aerial vehicle. In the aerial images, navigable areas of the scene may be occluded due to obstacles. Naively planning paths using aerial images may result in longer paths as a conservative planner may try to avoid regions that are occluded. We propose a modular, deep learning based framework that allows the robot to predict the existence of navigable areas in the occluded regions. Specifically, we use image inpainting methods to fill in parts of the areas that are potentially occluded, which can then be semantically segmented to determine navigability. We use supervised neural networks for both modules. However, these predictions may be incorrect. Therefore, we extract uncertainty in these predictions and use a risk aware approach that takes these uncertainties into account for path planning. We compare modules in our approach with non learning based approaches to show the efficacy of the proposed framework through photo realistic simulations. The modular pipeline allows further improvement in path planning and deployment in different settings.


Selective Differential Privacy for Language Modeling. With the increasing adoption of language models in applications involving sensitive data, it has become crucial to protect these models from leaking private information. Previous work has attempted to tackle this challenge by training RNN based language models with differential privacy guarantees. However, applying classical differential privacy to language models leads to poor model performance as the underlying privacy notion is over pessimistic and provides undifferentiated protection for all tokens of the data. Given that the private information in natural language is sparse (for example, the bulk of an email might not carry personally identifiable information), we propose a new privacy notion, selective differential privacy, to provide rigorous privacy guarantees on the sensitive portion of the data to improve model utility. To realize such a new notion, we develop a corresponding privacy mechanism, Selective DPSGD, for RNN based language models. Besides language modeling, we also apply the method to a more concrete application dialog systems. Experiments on both language modeling and dialog system building show that the proposed privacy preserving mechanism achieves better utilities while remaining safe under various privacy attacks compared to the baselines. The data, code and models are available at https github.com wyshi lm privacy.


On transversal numbers of intersecting straight line systems and intersecting segment systems. An intersecting r uniform straight line system is an intersecting linear system whose lines consist of r points on straight line segment of mathbb R 2 and any two lines share a point. Recently, the author A. V 'azquez 'Avila, emph On intersecting straight line systems , J. Discret. Math. Sci. Cryptogr. Accepted proved that any intersecting r uniform straight line system (P, mathcal L ) has transversal number at most nu 2 1 , with r geq nu 2 , where nu 2 is the maximum cardinality of a subset of lines R subseteq mathcal L such that every triplet of different elements of R does not have a common point. In this paper, we improve such upper bound if the intersecting r uniform straight line system satisfies r nu 2 . This result has immediate consequences for some questions given by Oliveros et al. D. Oliveros, C. O'Neill and S. Zerbib, emph The geometry and combinatorics of discrete line segment hypergraphs , Discrete Math. bf 343 (2020), no. 6, 111825 .


Pose and Semantic Map Based Probabilistic Forecast of Vulnerable Road Users' Trajectories. In this article, an approach for probabilistic trajectory forecasting of vulnerable road users (VRUs) is presented, which considers past movements and the surrounding scene. Past movements are represented by 3D poses reflecting the posture and movements of individual body parts. The surrounding scene is modeled in the form of semantic maps showing, e.g., the course of streets, sidewalks, and the occurrence of obstacles. The forecasts are generated in grids discretizing the space and in the form of arbitrary discrete probability distributions. The distributions are evaluated in terms of their reliability, sharpness, and positional accuracy. We compare our method with an approach that provides forecasts in the form of Gaussian distributions and discuss the respective advantages and disadvantages. Thereby, we investigate the impact of using poses and semantic maps. With a technique called spatial label smoothing, our approach achieves reliable forecasts. Overall, the poses have a positive impact on the forecasts. The semantic maps offer the opportunity to adapt the probability distributions to the individual situation, although at the considered forecasted time horizon of 2.52 s they play a minor role compared to the past movements of the VRU. Our method is evaluated on a dataset recorded in inner city traffic using a research vehicle. The dataset is made publicly available.


Vibration Analysis of Timoshenko Beams using Isogeometric Analysis. In this paper, the finite free form beam element is formulated by the isogeometric approach based on the Timoshenko beam theory to investigate the free vibration behavior of the beams. The non uniform rational B splines (NURBS) functions which define the geometry of the beam are used as the basis functions for the finite element analysis. In order to enrich the basis functions and to increase the accuracy of the solution fields, the h , p , and k refinement techniques are implemented. The geometry and curvature of the beams are modelled in a unique way based on NURBS. All the effects of the the shear deformation, and the rotary inertia are taken into consideration by the present isogeometric model. Results of the beams for non dimensional frequencies are compared with other available results in order to show the accuracy and efficiency of the present isogeometric approach. From numerical results, the present element can produce very accurate values of natural frequencies and the mode shapes due to exact definition of the geometry. With higher order basis functions, there is no shear locking phenomenon in very thin beam situations. Finally, the benchmark tests described in this study are provided as future reference solutions for Timoshenko beam vibration problem.


Did I delete my cookies? Cookies respawning with browser fingerprinting. Stateful and stateless web tracking gathered much attention in the last decade, however they were always measured separately. To the best of our knowledge, our study is the first to detect and measure cookie respawning with browser and machine fingerprinting. We develop a detection methodology that allows us to detect cookies dependency on browser and machine features. Our results show that 1,150 out of the top 30, 000 Alexa websites deploy this tracking mechanism. We further uncover how domains collaborate to respawn cookies through fingerprinting. We find out that this technique can be used to track users across websites even when third party cookies are deprecated. Together with a legal scholar, we conclude that cookie respawning with browser fingerprinting lacks legal interpretation under the GDPR and the ePrivacy directive, but its use in practice may breach them, thus subjecting it to fines up to 20 million euro.


The diameter of caterpillar associahedra. The caterpillar associahedron mathcal A (G) is a polytope arising from the rotation graph of search trees on a caterpillar tree G , generalizing the rotation graph of binary search trees (BSTs) and thus the conventional associahedron. We show that the diameter of mathcal A (G) is Theta(n m cdot (H 1)) , where n is the number of vertices, m is the number of leaves, and H is the entropy of the leaf distribution of G . Our proofs reveal a strong connection between caterpillar associahedra and searching in BSTs. We prove the lower bound using Wilber's first lower bound for dynamic BSTs, and the upper bound by reducing the problem to searching in static BSTs.


A singlet and triplet excited state dynamics study of the keto and enol tautomers of cytosine. The photoinduced excited state dynamics of the keto and enol forms of cytosine is investigated using ab initio surface hopping in order to understand the outcome of molecular beam femtosecond pump probe photoionization spectroscopy experiments. Both singlet and triplet states are included in the dynamics. The results show that triplet states play a significant role in the relaxation of the keto tautomer, while they are less important in the enol tautomer. In both forms, the T 1 state minimum is found too low in energy to be detected in standard photoionization spectroscopy experiments and therefore experimental decay times should arise from a simultaneous relaxation to the ground state and additional intersystem crossing followed by internal conversion to the T 1 state. In agreement with available experimental lifetimes, we observe three decay constants of 7 fs, 270 fs and 1900 fs the first two coming from the keto tautomer and the longer one from the enol tautomer. Deactivation of the enol form is due to internal conversion to the ground state via two S 1 S 0 conical intersections of ethylenic type.


On multiplicative energy of subsets of varieties. We obtain a non trivial upper bound for the multiplicative energy of any sufficiently large subset of a subvariety of a finite algebraic group. We also find some applications of our results to growth of conjugates classes, estimates of exponential sums and the restriction phenomenon.


X2Teeth 3D Teeth Reconstruction from a Single Panoramic Radiograph. 3D teeth reconstruction from X ray is important for dental diagnosis and many clinical operations. However, no existing work has explored the reconstruction of teeth for a whole cavity from a single panoramic radiograph. Different from single object reconstruction from photos, this task has the unique challenge of constructing multiple objects at high resolutions. To conquer this task, we develop a novel ConvNet X2Teeth that decomposes the task into teeth localization and single shape estimation. We also introduce a patch based training strategy, such that X2Teeth can be end to end trained for optimal performance. Extensive experiments show that our method can successfully estimate the 3D structure of the cavity and reflect the details for each tooth. Moreover, X2Teeth achieves a reconstruction IoU of 0.681, which significantly outperforms the encoder decoder method by 1.71X and the retrieval based method by 1.52X. Our method can also be promising for other multi anatomy 3D reconstruction tasks.


Learning with Different Amounts of Annotation From Zero to Many Labels. Training NLP systems typically assumes access to annotated data that has a single human label per example. Given imperfect labeling from annotators and inherent ambiguity of language, we hypothesize that single label is not sufficient to learn the spectrum of language interpretation. We explore new annotation distribution schemes, assigning multiple labels per example for a small subset of training examples. Introducing such multi label examples at the cost of annotating fewer examples brings clear gains on natural language inference task and entity typing task, even when we simply first train with a single label data and then fine tune with multi label examples. Extending a MixUp data augmentation framework, we propose a learning algorithm that can learn from training examples with different amount of annotation (with zero, one, or multiple labels). This algorithm efficiently combines signals from uneven training data and brings additional gains in low annotation budget and cross domain settings. Together, our method achieves consistent gains in two tasks, suggesting distributing labels unevenly among training examples can be beneficial for many NLP tasks.


Using a Neural Network to Detect Anomalies given an N gram Profile. In order to detect unknown intrusions and runtime errors of computer programs, the cyber security community has developed various detection techniques. Anomaly detection is an approach that is designed to profile the normal runtime behavior of computer programs in order to detect intrusions and errors as anomalous deviations from the observed normal. However, normal but unobserved behavior can trigger false positives. This limitation has significantly decreased the practical viability of anomaly detection techniques. Reported approaches to this limitation span a simple alert threshold definition to distribution models for approximating all normal behavior based on the limited observation. However, each assumption or approximation poses the potential for even greater false positive rates. This paper presents our study on how to explain the presence of anomalies using a neural network, particularly Long Short Term Memory, independent of actual data distributions. We present and compare three anomaly detection models, and report on our experience running different types of attacks on an Apache Hypertext Transfer Protocol server. We performed a comparative study, focusing on each model's ability to detect the onset of each attack while avoiding false positives resulting from unknown normal behavior. Our best performing model detected the true onset of every attack with zero false positives.


Discovering Boundary Values of Feature based Machine Learning Classifiers through Exploratory Datamorphic Testing. Testing has been widely recognised as difficult for AI applications. This paper proposes a set of testing strategies for testing machine learning applications in the framework of the datamorphism testing methodology. In these strategies, testing aims at exploring the data space of a classification or clustering application to discover the boundaries between classes that the machine learning application defines. This enables the tester to understand precisely the behaviour and function of the software under test. In the paper, three variants of exploratory strategies are presented with the algorithms implemented in the automated datamorphic testing tool Morphy. The correctness of these algorithms are formally proved. Their capability and cost of discovering borders between classes are evaluated via a set of controlled experiments with manually designed subjects and a set of case studies with real machine learning models.


Hardy's inequality for Hermite expansions revisited. In this article, we give a short proof of Hardy's inequality for Hermite expansions of functions in the classical Hardy spaces H p( mathbb R n ) , by using an atomic decomposition of the Hardy spaces associated with the Hermite operators. When the space dimension is 1 , we obtain a new estimate of Hardy's inequality for Hermite expansions in H p( mathbb R ) for the range 0 p 1.


130 mA mm beta Ga 2 O 3 MESFET with Low Temperature MOVPE Regrown Ohmic Contacts. We report on the demonstration of metalorganic vapor phase epitaxy regrown (MOVPE) ohmic contacts in an all MOVPE grown beta Ga 2 O 3 metal semiconductor field effect transistor (MESFET). The low temperature (600 circ C) heavy (n ) Si doped regrown layers exhibit extremely high conductivity with sheet resistance of 73 Omega square and record low metal n Ga 2 O 3 contact resistance of 80 m Omega .mm and specific contact resistivity of 8.3 times 10 7 Omega .cm 2 were achieved. The fabricated MESFETs exhibit a maximum drain to source current of 130 mA mm, a high I ON I OFF of 10 10 with a high power FOM of 25 MW cm 2 were achieved without any field plates. Nanoparticle assisted Raman thermometry, thermal modeling, and infrared thermography were performed to assess the device self heating under the high current and power conditions. This demonstration shows the promise of MOVPE technique for the realization of high performance lateral beta Ga 2 O 3 devices and also highlights the need for device level thermal management.


Vector potential based MHD solver for non periodic flows using Fourier continuation expansions. A high order method to evolve in time electromagnetic and velocity fields in conducting fluids with non periodic boundaries is presented. The method has a small overhead compared with fast FFT based pseudospectral methods in periodic domains. It uses the magnetic vector potential formulation for accurately enforcing the null divergence of the magnetic field, and allowing for different boundary conditions including perfectly conducting walls or vacuum surroundings, two cases relevant for many astrophysical, geophysical, and industrial flows. A spectral Fourier continuation method is used to accurately represent all fields and their spatial derivatives, allowing also for efficient solution of Poisson equations with different boundaries. A study of conducting flows at different Reynolds and Hartmann numbers, and with different boundary conditions, is presented to study convergence of the method and the accuracy of the solenoidal and boundary conditions.


Global Information Guided Video Anomaly Detection. Video anomaly detection (VAD) is currently a challenging task due to the complexity of anomaly as well as the lack of labor intensive temporal annotations. In this paper, we propose an end to end Global Information Guided (GIG) anomaly detection framework for anomaly detection using the video level annotations (i.e., weak labels). We propose to first mine the global pattern cues by leveraging the weak labels in a GIG module. Then we build a spatial reasoning module to measure the relevance between vectors in spatial domain with the global cue vectors, and select the most related feature vectors for temporal anomaly detection. The experimental results on the CityScene challenge demonstrate the effectiveness of our model.


Existence theorem of finite Krasner hyperfields. The concern of this paper is to show that there always exist Krasner hyperfields of order n, where n is an integer greater than or equal to 2.


Extremal problems on Sombor indices of unicyclic graphs with a given diameter. Sombor index is a novel topological index, which was introduced by Gutman and defined for a graph G as SO(G) sum limits uv in E(G) sqrt d u 2 d v 2 , where d u d G (u) denotes the degree of vertex u in graph G . Extremal problems on the Sombor index for trees with a given diameter has been considered by Chen et al. H. Chen, W. Li, J. Wang, Extremal values on the Sombor index of trees, MATCH Commun. Math. Comput. Chem. 87 (2022) 23 49 and Li et al. S. Li, Z. Wang, M. Zhang, On the extremal Sombor index of trees with a given diameter, Appl. Math. Comput. 416 (2022) 126731 . As an extension of results introduces above, we determine the maximum Sombor indices for unicyclic graphs with a fixed order and given diameter.


From temporal network data to the dynamics of social relationships. Networks are well established representations of social systems, and temporal networks are widely used to study their dynamics. Temporal network data often consist in a succession of static networks over consecutive time windows whose length, however, is arbitrary, not necessarily corresponding to any intrinsic timescale of the system. Moreover, the resulting view of social network evolution is unsatisfactory short time windows contain little information, whereas aggregating over large time windows blurs the dynamics. Going from a temporal network to a meaningful evolving representation of a social network therefore remains a challenge. Here we introduce a framework to that purpose transforming temporal network data into an evolving weighted network where the weights of the links between individuals are updated at every interaction. Most importantly, this transformation takes into account the interdependence of social relationships due to the finite attention capacities of individuals each interaction between two individuals not only reinforces their mutual relationship but also weakens their relationships with others. We study a concrete example of such a transformation and apply it to several data sets of social interactions. Using temporal contact data collected in schools, we show how our framework highlights specificities in their structure and temporal organization. We then introduce a synthetic perturbation into a data set of interactions in a group of baboons to show that it is possible to detect a perturbation in a social group on a wide range of timescales and parameters. Our framework brings new perspectives to the analysis of temporal social networks.


K averaging agent based model propagation of chaos and convergence to equilibrium. The paper treats an agent based model with averaging dynamics to which we refer as the K averaging model. Broadly speaking, our model can be added to the growing list of dynamics exhibiting self organization such as the well known Vicsek type models 1, 2, 29 . In the K averaging model, each of the N particles updates their position by averaging over K randomly selected particles with additional noise. To make the K averaging dynamics more tractable, we first establish a propagation of chaos type result in the limit of infinite particle number (i.e. N to infty ) using a martingale technique. Then, we prove the convergence of the limit equation toward a suitable Gaussian distribution in the sense of Wasserstein distance as well as relative entropy. We provide additional numerical simulations to illustrate both results.


Supporting Multiparty Signing over Named Data Networking. Modern digitally controlled systems require multiparty authentication and authorization to meet the desired security requirement. This paper describes the design and development of NDN MPS, an automated solution to support multiparty signature signing and verification for NDN enabled applications. NDN MPS suggests several changes and extensions to the existing NDN security solutions. First, it introduces a new type of trust schema to support signing and verification for multiple signers under complex policies such as threshold schemes. Second, it extends the NDN signature format to accommodate multisignature schemes such as BLS signature. Third, it introduces a signature collection protocol to solicit signatures securely from multiple signers. We further evaluate NDN MPS by assessing its security properties and measuring its performance.


AppBuddy Learning to Accomplish Tasks in Mobile Apps via Reinforcement Learning. Human beings, even small children, quickly become adept at figuring out how to use applications on their mobile devices. Learning to use a new app is often achieved via trial and error, accelerated by transfer of knowledge from past experiences with like apps. The prospect of building a smarter smartphone one that can learn how to achieve tasks using mobile apps is tantalizing. In this paper we explore the use of Reinforcement Learning (RL) with the goal of advancing this aspiration. We introduce an RL based framework for learning to accomplish tasks in mobile apps. RL agents are provided with states derived from the underlying representation of on screen elements, and rewards that are based on progress made in the task. Agents can interact with screen elements by tapping or typing. Our experimental results, over a number of mobile apps, show that RL agents can learn to accomplish multi step tasks, as well as achieve modest generalization across different apps. More generally, we develop a platform which addresses several engineering challenges to enable an effective RL training environment. Our AppBuddy platform is compatible with OpenAI Gym and includes a suite of mobile apps and benchmark tasks that supports a diversity of RL research in the mobile app setting.


Synthetic Unknown Class Learning for Learning Unknowns. This paper addresses the open set recognition (OSR) problem, where the goal is to correctly classify samples of known classes while detecting unknown samples to reject. In the OSR problem, "unknown" is assumed to have infinite possibilities because we have no knowledge about unknowns until they emerge. Intuitively, the more an OSR system explores the possibilities of unknowns, the more likely it is to detect unknowns. Thus, this paper proposes a novel synthetic unknown class learning method that generates unknown like samples while maintaining diversity between the generated samples and learns these samples. In addition to this unknown sample generation process, knowledge distillation is introduced to provide room for learning synthetic unknowns. By learning the unknown like samples and known samples in an alternating manner, the proposed method can not only experience diverse synthetic unknowns but also reduce overgeneralization with respect to known classes. Experiments on several benchmark datasets show that the proposed method significantly outperforms other state of the art approaches. It is also shown that realistic unknown digits can be generated and learned via the proposed method after training on the MNIST dataset.


Surfer100 Generating Surveys From Web Resources, Wikipedia style. Fast developing fields such as Artificial Intelligence (AI) often outpace the efforts of encyclopedic sources such as Wikipedia, which either do not completely cover recently introduced topics or lack such content entirely. As a result, methods for automatically producing content are valuable tools to address this information overload. We show that recent advances in pretrained language modeling can be combined for a two stage extractive and abstractive approach for Wikipedia lead paragraph generation. We extend this approach to generate longer Wikipedia style summaries with sections and examine how such methods struggle in this application through detailed studies with 100 reference human collected surveys. This is the first study on utilizing web resources for long Wikipedia style summaries to the best of our knowledge.


Considerations towards quantitative X ray and neutron tensor tomography on the validity of linear approximations of dark field anisotropy. The validity of two approximative linear tensor models to be used for grating based X ray or neutron dark field tensor tomography is investigated in a simulation study. While the dark field contrast originating from anisotropic microscopic mass distributions has, in a previous study, been confirmed to be in general a non linear function of two orientations (optical axis and axis of interferometer sensitivity), linear approximations with a reduced parameter space (considering only one of the orientation dependencies) are highly preferable with respect to tomographic volume reconstruction from projections. By regarding isolated volume elements and systematically exploring the full range of possible anisotropies, direct correspondences are drawn between the respective tensors characterizing the complete model used for signal synthesization and the reduced linear models used for reconstruction. The tensors' dominant orientations are found to agree to a typical accuracy of 1 deg , with their eigenspectra exhibiting fuzzy, yet almost linear relations among each other. Although modeling only either of two orientation dependencies for the purpose of tensor reconstruction, the data acquisition scheme must nevertheless adequately address both dependencies.


physics.bio-ph cs.LG physics.data-an q-bio.MN q-bio.QM

Prediction of gene expression time series and structural analysis of gene regulatory networks using recurrent neural networks. Methods for time series prediction and classification of gene regulatory networks (GRNs) from gene expression data have been treated separately so far. The recent emergence of attention based recurrent neural networks (RNN) models boosted the interpretability of RNN parameters, making them appealing for the understanding of gene interactions. In this work, we generated synthetic time series gene expression data from a range of archetypal GRNs and we relied on a dual attention RNN to predict the gene temporal dynamics. We show that the prediction is extremely accurate for GRNs with different architectures. Next, we focused on the attention mechanism of the RNN and, using tools from graph theory, we found that its graph properties allow to hierarchically distinguish different architectures of the GRN. We show that the GRNs respond differently to the addition of noise in the prediction by the RNN and we relate the noise response to the analysis of the attention mechanism. In conclusion, this work provides a a way to understand and exploit the attention mechanism of RNN and it paves the way to RNN based methods for time series prediction and inference of GRNs from gene expression data.


Counterfactual Graphs for Explainable Classification of Brain Networks. Training graph classifiers able to distinguish between healthy brains and dysfunctional ones, can help identifying substructures associated to specific cognitive phenotypes. However, the mere predictive power of the graph classifier is of limited interest to the neuroscientists, which have plenty of tools for the diagnosis of specific mental disorders. What matters is the interpretation of the model, as it can provide novel insights and new hypotheses. In this paper we propose emph counterfactual graphs as a way to produce local post hoc explanations of any black box graph classifier. Given a graph and a black box, a counterfactual is a graph which, while having high structural similarity with the original graph, is classified by the black box in a different class. We propose and empirically compare several strategies for counterfactual graph search. Our experiments against a white box classifier with known optimal counterfactual, show that our methods, although heuristic, can produce counterfactuals very close to the optimal one. Finally, we show how to use counterfactual graphs to build global explanations correctly capturing the behaviour of different black box classifiers and providing interesting insights for the neuroscientists.


You should evaluate your language model on marginal likelihood over tokenisations. Neural language models typically tokenise input text into sub word units to achieve an open vocabulary. The standard approach is to use a single canonical tokenisation at both train and test time. We suggest that this approach is unsatisfactory and may bottleneck our evaluation of language model performance. Using only the one best tokenisation ignores tokeniser uncertainty over alternative tokenisations, which may hurt model out of domain performance. In this paper, we argue that instead, language models should be evaluated on their marginal likelihood over tokenisations. We compare different estimators for the marginal likelihood based on sampling, and show that it is feasible to estimate the marginal likelihood with a manageable number of samples. We then evaluate pretrained English and German language models on both the one best tokenisation and marginal perplexities, and show that the marginal perplexity can be significantly better than the one best, especially on out of domain data. We link this difference in perplexity to the tokeniser uncertainty as measured by tokeniser entropy. We discuss some implications of our results for language model training and evaluation, particularly with regard to tokenisation robustness.


Learning Task Informed Abstractions. Current model based reinforcement learning methods struggle when operating from complex visual scenes due to their inability to prioritize task relevant features. To mitigate this problem, we propose learning Task Informed Abstractions (TIA) that explicitly separates reward correlated visual features from distractors. For learning TIA, we introduce the formalism of Task Informed MDP (TiMDP) that is realized by training two models that learn visual features via cooperative reconstruction, but one model is adversarially dissociated from the reward signal. Empirical evaluation shows that TIA leads to significant performance gains over state of the art methods on many visual control tasks where natural and unconstrained visual distractions pose a formidable challenge.


Task Guided Inverse Reinforcement Learning Under Partial Information. We study the problem of inverse reinforcement learning (IRL), where the learning agent recovers a reward function using expert demonstrations. Most of the existing IRL techniques make the often unrealistic assumption that the agent has access to full information about the environment. We remove this assumption by developing an algorithm for IRL in partially observable Markov decision processes (POMDPs). The algorithm addresses several limitations of existing techniques that do not take the information asymmetry between the expert and the learner into account. First, it adopts causal entropy as the measure of the likelihood of the expert demonstrations as opposed to entropy in most existing IRL techniques, and avoids a common source of algorithmic complexity. Second, it incorporates task specifications expressed in temporal logic into IRL. Such specifications may be interpreted as side information available to the learner a priori in addition to the demonstrations and may reduce the information asymmetry. Nevertheless, the resulting formulation is still nonconvex due to the intrinsic nonconvexity of the so called forward problem, i.e., computing an optimal policy given a reward function, in POMDPs. We address this nonconvexity through sequential convex programming and introduce several extensions to solve the forward problem in a scalable manner. This scalability allows computing policies that incorporate memory at the expense of added computational cost yet also outperform memoryless policies. We demonstrate that, even with severely limited data, the algorithm learns reward functions and policies that satisfy the task and induce a similar behavior to the expert by leveraging the side information and incorporating memory into the policy.


Left exact Localizations of infty Topoi I Higher Sheaves. We are developing tools for working with arbitrary left exact localizations of infty topoi. We introduce a notion of higher sheaf with respect to an arbitrary set of maps Sigma in an infty topos mathscr E . We show that the full subcategory of higher sheaves mathrm Sh ( mathscr E , Sigma) is an infty topos, and that the sheaf reflection mathscr E to mathrm Sh ( mathscr E , Sigma) is the left exact localization generated by Sigma . The proof depends on the notion of congruence, which is a substitute for the notion of Grothendieck topology in 1 topos theory.


Virtual element approximation of two dimensional parabolic variational inequalities. We design a virtual element method for the numerical treatment of the two dimensional parabolic variational inequality problem on unstructured polygonal meshes. Due to the expected low regularity of the exact solution, the virtual element method is based on the lowest order virtual element space that contains the subspace of the linear polynomials defined on each element. The connection between the nonnegativity of the virtual element functions and the nonnegativity of the degrees of freedom, i.e., the values at the mesh vertices, is established by applying the Maximum and Minimum Principle Theorem. The mass matrix is computed through an approximate L 2 polynomial projection, whose properties are carefully investigated in the paper. We prove the well posedness of the resulting scheme in two different ways that reveal the contractive nature of the VEM and its connection with the minimization of quadratic functionals. The convergence analysis requires the existence of a nonnegative quasi interpolation operator, whose construction is also discussed in the paper. The variational crime introduced by the virtual element setting produces five error terms that we control by estimating a suitable upper bound. Numerical experiments confirm the theoretical convergence rate for the refinement in space and time on three different mesh families including distorted squares, nonconvex elements, and Voronoi tesselations.


PROVES Establishing Image Provenance using Semantic Signatures. Modern AI tools, such as generative adversarial networks, have transformed our ability to create and modify visual data with photorealistic results. However, one of the deleterious side effects of these advances is the emergence of nefarious uses in manipulating information in visual data, such as through the use of deep fakes. We propose a novel architecture for preserving the provenance of semantic information in images to make them less susceptible to deep fake attacks. Our architecture includes semantic signing and verification steps. We apply this architecture to verifying two types of semantic information individual identities (faces) and whether the photo was taken indoors or outdoors. Verification accounts for a collection of common image transformation, such as translation, scaling, cropping, and small rotations, and rejects adversarial transformations, such as adversarially perturbed or, in the case of face verification, swapped faces. Experiments demonstrate that in the case of provenance of faces in an image, our approach is robust to black box adversarial transformations (which are rejected) as well as benign transformations (which are accepted), with few false negatives and false positives. Background verification, on the other hand, is susceptible to black box adversarial examples, but becomes significantly more robust after adversarial training.


Low Resource Dialogue Summarization with Domain Agnostic Multi Source Pretraining. With the rapid increase in the volume of dialogue data from daily life, there is a growing demand for dialogue summarization. Unfortunately, training a large summarization model is generally infeasible due to the inadequacy of dialogue data with annotated summaries. Most existing works for low resource dialogue summarization directly pretrain models in other domains, e.g., the news domain, but they generally neglect the huge difference between dialogues and conventional articles. To bridge the gap between out of domain pretraining and in domain fine tuning, in this work, we propose a multi source pretraining paradigm to better leverage the external summary data. Specifically, we exploit large scale in domain non summary data to separately pretrain the dialogue encoder and the summary decoder. The combined encoder decoder model is then pretrained on the out of domain summary data using adversarial critics, aiming to facilitate domain agnostic summarization. The experimental results on two public datasets show that with only limited training data, our approach achieves competitive performance and generalizes well in different dialogue scenarios.


Generating Smooth Pose Sequences for Diverse Human Motion Prediction. Recent progress in stochastic motion prediction, i.e., predicting multiple possible future human motions given a single past pose sequence, has led to producing truly diverse future motions and even providing control over the motion of some body parts. However, to achieve this, the state of the art method requires learning several mappings for diversity and a dedicated model for controllable motion prediction. In this paper, we introduce a unified deep generative network for both diverse and controllable motion prediction. To this end, we leverage the intuition that realistic human motions consist of smooth sequences of valid poses, and that, given limited data, learning a pose prior is much more tractable than a motion one. We therefore design a generator that predicts the motion of different body parts sequentially, and introduce a normalizing flow based pose prior, together with a joint angle loss, to achieve motion realism.Our experiments on two standard benchmark datasets, Human3.6M and HumanEva I, demonstrate that our approach outperforms the state of the art baselines in terms of both sample diversity and accuracy. The code is available at https github.com wei mao 2019 gsps


Existence of resonances for Schrodinger operators on hyperbolic space. We prove existence results and lower bounds for the resonances of Schr "odinger operators associated to smooth, compactly support potentials on hyperbolic space. The results are derived from a combination heat and wave trace expansions and asymptotics of the scattering phase.


Quantitative matrix weighted estimates for certain singular integral operators. In this paper quantitative weighted matrix estimates for vector valued extensions of L r' H "ormander operators and rough singular integrals are studied. Strong type (p,p) estimates, endpoint estimates, and some new results on Coifman Fefferman estimates assuming A infty and C p condition counterparts are provided. To prove the aforementioned estimates we rely upon some suitable convex body domination results that we settle as well in this paper.


Extremizing Temperature Functions of Rods with Robin Boundary Conditions. We compare the solutions of two one dimensional Poisson problems on an interval with Robin boundary conditions, one with given data, and one where the data has been symmetrized. When the Robin parameter is positive and the symmetrization is symmetric decreasing rearrangement, we prove that the solution to the symmetrized problem has larger increasing convex means. When the Robin parameter equals zero (so that we have Neumann boundary conditions) and the symmetrization is decreasing rearrangement, we similarly show that the solution to the symmetrized problem has larger convex means.


Nonexistence of a Universal Algorithm for Traveling Salesman Problems in Constructive Mathematics. Proposed initially from a practical circumstance, the traveling salesman problem caught the attention of numerous economists, computer scientists, and mathematicians. These theorists were instead intrigued by seeking a systemic way to find the optimal route. Many attempts have been made along the way and all concluded the nonexistence of a general algorithm that determines optimal solution to all traveling salesman problems alike. In this study, we present proof for the nonexistence of such an algorithm for both asymmetric (with oriented roads) and symmetric (with unoriented roads) traveling salesman problems in the setup of constructive mathematics.


DETR3D 3D Object Detection from Multi view Images via 3D to 2D Queries. We introduce a framework for multi camera 3D object detection. In contrast to existing works, which estimate 3D bounding boxes directly from monocular images or use depth prediction networks to generate input for 3D object detection from 2D information, our method manipulates predictions directly in 3D space. Our architecture extracts 2D features from multiple camera images and then uses a sparse set of 3D object queries to index into these 2D features, linking 3D positions to multi view images using camera transformation matrices. Finally, our model makes a bounding box prediction per object query, using a set to set loss to measure the discrepancy between the ground truth and the prediction. This top down approach outperforms its bottom up counterpart in which object bounding box prediction follows per pixel depth estimation, since it does not suffer from the compounding error introduced by a depth prediction model. Moreover, our method does not require post processing such as non maximum suppression, dramatically improving inference speed. We achieve state of the art performance on the nuScenes autonomous driving benchmark.


Open Domain Question Answering for COVID 19 and Other Emergent Domains. Since late 2019, COVID 19 has quickly emerged as the newest biomedical domain, resulting in a surge of new information. As with other emergent domains, the discussion surrounding the topic has been rapidly changing, leading to the spread of misinformation. This has created the need for a public space for users to ask questions and receive credible, scientific answers. To fulfill this need, we turn to the task of open domain question answering, which we can use to efficiently find answers to free text questions from a large set of documents. In this work, we present such a system for the emergent domain of COVID 19. Despite the small data size available, we are able to successfully train the system to retrieve answers from a large scale corpus of published COVID 19 scientific papers. Furthermore, we incorporate effective re ranking and question answering techniques, such as document diversity and multiple answer spans. Our open domain question answering system can further act as a model for the quick development of similar systems that can be adapted and modified for other developing emergent domains.


Convexity estimate for translating solitons of concave fully nonlinear extrinsic geometric flows in mathbb R n 1 . The main result of this paper is a convexity estimate for translating solitons of extrinsic geometric flows which evolve under a 1 homogeneous concave function in the principal curvatures. In addition, we show examples of these hypersurfaces in mathbb R n 1 for particular functions.


The harmonic mean formula for random processes. Motivated by the harmonic mean formula in 1 , we investigate the relation between the sojourn time and supremum of a random process X(t),t in mathbb R d and extend the harmonic mean formula for general stochastically continuous X . We discuss two applications concerning the continuity of distribution of supremum of X and representations of classical Pickands constants.


Solving Bang Bang Problems Using The Immersed Interface Method and Integer Programming. In this paper we study numerically solving optimal control problems with bang bang control functions. We present a formal Lagrangian approach for solving the optimal control problem, and address difficulties encountered when numerically solving the state and adjoint equations by using the immersed interface method. We note that our numerical approach does not approximate the discontinuous control function with smooth functions, instead we solve the true bang bang optimal control problem. Our approach for solving the optimal control problem uses an adjoint based gradient. We use the gradient in our first order trust region method to generate a local minimizing control. We present detailed numerical results to demonstrate the effectiveness of our method.


Privacy Assessment of Federated Learning using Private Personalized Layers. Federated Learning (FL) is a collaborative scheme to train a learning model across multiple participants without sharing data. While FL is a clear step forward towards enforcing users' privacy, different inference attacks have been developed. In this paper, we quantify the utility and privacy trade off of a FL scheme using private personalized layers. While this scheme has been proposed as local adaptation to improve the accuracy of the model through local personalization, it has also the advantage to minimize the information about the model exchanged with the server. However, the privacy of such a scheme has never been quantified. Our evaluations using motion sensor dataset show that personalized layers speed up the convergence of the model and slightly improve the accuracy for all users compared to a standard FL scheme while better preventing both attribute and membership inferences compared to a FL scheme using local differential privacy.


Is Einstein more agreeable and less neurotic than Hitler? A computational exploration of the emotional and personality profiles of historical persons. Recent progress in distributed semantic models (DSM) offers new ways to estimate personality traits of both fictive and real people. In this exploratory study we applied an extended version of the algorithm developed in Jacobs (2019) to compute the likeability scores, emotional figure profiles and BIG5 personality traits for 100 historical persons from the arts, politics or science domains whose names are rather unique (e.g., Einstein, Kahlo, Picasso). We compared the results produced by static (word2vec) and dynamic (BERT) language model representations in four studies. The results show both the potential and limitations of such DSM based computations of personality profiles and point ways to further develop this approach to become a useful tool in data science, psychology or computational and neurocognitive poetics (Jacobs, 2015).


EADNet Efficient Asymmetric Dilated Network for Semantic Segmentation. Due to real time image semantic segmentation needs on power constrained edge devices, there has been an increasing desire to design lightweight semantic segmentation neural network, to simultaneously reduce computational cost and increase inference speed. In this paper, we propose an efficient asymmetric dilated semantic segmentation network, named EADNet, which consists of multiple developed asymmetric convolution branches with different dilation rates to capture the variable shapes and scales information of an image. Specially, a multi scale multi shape receptive field convolution (MMRFC) block with only a few parameters is designed to capture such information. Experimental results on the Cityscapes dataset demonstrate that our proposed EADNet achieves segmentation mIoU of 67.1 with smallest number of parameters (only 0.35M) among mainstream lightweight semantic segmentation networks.


A feast for trolls Engagement analysis of counternarratives against online toxicity. This report provides an engagement analysis of counternarratives against online toxicity. Between February 2020 and July 2021, we observed over 15 million toxic messages on social media identified by our fine grained, multilingual detection AI. Over 1,000 dashboard users responded to toxic messages with combinations of visual memes, text, or AI generated text, or they reported content. This leads to new, real life insights on self regulatory approaches for the mitigation of online hate.


Balanced pairs and recollements in extriangulated categories with negative first extensions. A notion of balanced pairs in an extriangulated category with a negative first extension is defined in this article. We prove that there exists a bijective correspondence between balanced pairs and proper classes xi with enough xi projectives and enough xi injectives. It can be regarded as a simultaneous generalization of Fu Hu Zhang Zhu and Wang Li Huang. Besides, we show that if ( mathcal A , mathcal B, mathcal C) is a recollement of extriangulated categories, then balanced pairs in mathcal B can induce balanced pairs in mathcal A and mathcal C under natural assumptions. As a application, this result gengralizes a result by Fu Hu Yao in abelian categories. Moreover, it highlights a new phenomena when it applied to triangulated categories.


ERASOR Egocentric Ratio of Pseudo Occupancy based Dynamic Object Removal for Static 3D Point Cloud Map Building. Scan data of urban environments often include representations of dynamic objects, such as vehicles, pedestrians, and so forth. However, when it comes to constructing a 3D point cloud map with sequential accumulations of the scan data, the dynamic objects often leave unwanted traces in the map. These traces of dynamic objects act as obstacles and thus impede mobile vehicles from achieving good localization and navigation performances. To tackle the problem, this paper presents a novel static map building method called ERASOR, Egocentric RAtio of pSeudo Occupancy based dynamic object Removal, which is fast and robust to motion ambiguity. Our approach directs its attention to the nature of most dynamic objects in urban environments being inevitably in contact with the ground. Accordingly, we propose the novel concept called pseudo occupancy to express the occupancy of unit space and then discriminate spaces of varying occupancy. Finally, Region wise Ground Plane Fitting (R GPF) is adopted to distinguish static points from dynamic points within the candidate bins that potentially contain dynamic points. As experimentally verified on SemanticKITTI, our proposed method yields promising performance against state of the art methods overcoming the limitations of existing ray tracing based and visibility based methods.


Rethinking Text Line Recognition Models. In this paper, we study the problem of text line recognition. Unlike most approaches targeting specific domains such as scene text or handwritten documents, we investigate the general problem of developing a universal architecture that can extract text from any image, regardless of source or input modality. We consider two decoder families (Connectionist Temporal Classification and Transformer) and three encoder modules (Bidirectional LSTMs, Self Attention, and GRCLs), and conduct extensive experiments to compare their accuracy and performance on widely used public datasets of scene and handwritten text. We find that a combination that so far has received little attention in the literature, namely a Self Attention encoder coupled with the CTC decoder, when compounded with an external language model and trained on both public and internal data, outperforms all the others in accuracy and computational complexity. Unlike the more common Transformer based models, this architecture can handle inputs of arbitrary length, a requirement for universal line recognition. Using an internal dataset collected from multiple sources, we also expose the limitations of current public datasets in evaluating the accuracy of line recognizers, as the relatively narrow image width and sequence length distributions do not allow to observe the quality degradation of the Transformer approach when applied to the transcription of long lines.


Perverse sheaves on varieties with large fundamental groups. We conjecture that any perverse sheaf on a compact aspherical K "ahler manifold has non negative Euler characteristic. This extends the Singer Hopf conjecture in the K "ahler setting. We verify the stronger conjecture when the manifold X has non positive holomorphic bisectional curvature. We also show that the conjecture holds when X is projective and in possession of a faithful semi simple rigid local system. The first result is proved by expressing the Euler characteristic as an intersection number involving the characteristic cycle, and then using the curvature conditions to deduce non negativity. For the second result, we have that the local system underlies a complex variation of Hodge structure. We then deduce the desired inequality from the curvature properties of the image of the period map.


PHASER a Robust and Correspondence free Global Pointcloud Registration. We propose PHASER, a correspondence free global registration of sensor centric pointclouds that is robust to noise, sparsity, and partial overlaps. Our method can seamlessly handle multimodal information and does not rely on keypoint nor descriptor preprocessing modules. By exploiting properties of Fourier analysis, PHASER operates directly on the sensor's signal, fusing the spectra of multiple channels and computing the 6 DoF transformation based on correlation. Our registration pipeline starts by finding the most likely rotation followed by computing the most likely translation. Both estimates are distributed according to a probability distribution that takes the underlying manifold into account, i.e., a Bingham and Gaussian distribution, respectively. This further allows our approach to consider the periodic nature of rotations and naturally represent its uncertainty. We extensively compare PHASER against several well known registration algorithms on both simulated datasets, and real world data acquired using different sensor configurations. Our results show that PHASER can globally align pointclouds in less than 100ms with an average accuracy of 2cm and 0.5deg, is resilient against noise, and can handle partial overlap.


Homogenisation of dynamical optimal transport on periodic graphs. This paper deals with the large scale behaviour of dynamical optimal transport on mathbb Z d periodic graphs with general lower semicontinuous and convex energy densities. Our main contribution is a homogenisation result that describes the effective behaviour of the discrete problems in terms of a continuous optimal transport problem. The effective energy density can be explicitly expressed in terms of a cell formula, which is a finite dimensional convex programming problem that depends non trivially on the local geometry of the discrete graph and the discrete energy density. Our homogenisation result is derived from a Gamma convergence result for action functionals on curves of measures, which we prove under very mild growth conditions on the energy density. We investigate the cell formula in several cases of interest, including finite volume discretisations of the Wasserstein distance, where non trivial limiting behaviour occurs.


ZZ Polynomials of Regular m tier Benzenoid Strips as Extended Strict Order Polynomials of Associated Posets Part 1. Proof of Equivalence. In Part 1 of the current series of papers, we demonstrate the equivalence between the Zhang Zhang polynomial text ZZ ( boldsymbol S ,x) of a Kekul 'ean regular m tier strip boldsymbol S of length n and the extended strict order polynomial text E mathcal S circ (n,x 1) of a certain partially ordered set (poset) mathcal S associated with boldsymbol S . The discovered equivalence is a consequence of the one to one correspondence between the set left K right of Kekul 'e structures of boldsymbol S and the set left mu mathcal S supset mathcal A rightarrow left ,n , right right of strictly order preserving maps from the induced subposets of mathcal S to the interval left thinspace n thinspace right . As a result, the problems of determining the Zhang Zhang polynomial of boldsymbol S and of generating the complete set of Clar covers of boldsymbol S reduce to the problem of constructing the set mathcal L ( mathcal S ) of linear extensions of the corresponding poset mathcal S and studying their basic properties. In particular, the Zhang Zhang polynomial of boldsymbol S can be written in a compact form as text ZZ ( boldsymbol S ,x) sum k 0 left mathcal S right sum w in mathcal L ( mathcal S ) binom left mathcal S right text fix mathcal S (w) , ,k , , hspace 1pt text fix mathcal S (w) binom n text des (w) k left(1 x right) k , where text des (w) and text fix mathcal S (w) denote the number of descents and the number of fixed labels, respectively, in the linear extension w in mathcal L ( mathcal S ) .


Quantum Mechanics and Machine Learning Synergies Graph Attention Neural Networks to Predict Chemical Reactivity. There is a lack of scalable quantitative measures of reactivity for functional groups in organic chemistry. Measuring reactivity experimentally is costly and time consuming and does not scale to the astronomical size of chemical space. In previous quantum chemistry studies, we have introduced Methyl Cation Affinities (MCA ) and Methyl Anion Affinities (MAA ), using a solvation model, as quantitative measures of reactivity for organic functional groups over the broadest range. Although MCA and MAA offer good estimates of reactivity parameters, their calculation through Density Functional Theory (DFT) simulations is time consuming. To circumvent this problem, we first use DFT to calculate MCA and MAA for more than 2,400 organic molecules thereby establishing a large dataset of chemical reactivity scores. We then design deep learning methods to predict the reactivity of molecular structures and train them using this curated dataset in combination with different representations of molecular structures. Using ten fold cross validation, we show that graph attention neural networks applied to informative input fingerprints produce the most accurate estimates of reactivity, achieving over 91 test accuracy for predicting the MCA plus minus 3.0 or MAA plus minus 3.0, over 50 orders of magnitude. Finally, we demonstrate the application of these reactivity scores to two tasks (1) chemical reaction prediction (2) combinatorial generation of reaction mechanisms. The curated dataset of MCA and MAA scores is available through the ChemDB chemoinformatics web portal at www.cdb.ics.uci.edu.


Nontrivial solutions of systems of perturbed Hammerstein integral equations with functional terms. We discuss the solvability of a fairly general class of systems of perturbed Hammerstein integral equations with functional terms that depend on several parameters. The nonlinearities and the functionals are allowed to depend on the components of the system and their derivatives. The results are applicable to systems of nonlocal second order ordinary differential equations subject to functional boundary conditions, this is illustrated in an example. Our approach is based on the classical fixed point index.


On the big quantum cohomology of coadjoint varieties. This paper is devoted to the study of the quantum cohomology of coadjoint varieties of simple algebraic groups across all Dynkin types. We determine the non semisimple factors of the small quantum cohomology ring and relate them to ADE singularities. Moreover, we show that the big quantum cohomology of a coadjoint variety is always generically semisimple even though in most cases the small quantum cohomology is not.


An Evaluation of Cryptocurrency Payment Channel Networks and Their Privacy Implications. Cryptocurrencies redefined how money can be stored and transferred among users. However, independent of the amount being sent, public blockchain based cryptocurrencies suffer from high transaction waiting times and fees. These drawbacks hinder the wide use of cryptocurrencies by masses. To address these challenges, payment channel network concept is touted as the most viable solution to be used for micro payments. The idea is exchanging the ownership of money by keeping the state of the accounts locally. The users inform the blockchain rarely, which decreases the load on the blockchain. Specifically, payment channel networks can provide transaction approvals in seconds by charging a nominal fee proportional to the payment amount. Such attraction on payment channel networks inspired many recent studies which focus on how to design them and allocate channels such that the transactions will be secure and efficient. However, as payment channel networks are emerging and reaching large number of users, privacy issues are becoming more relevant that raise concerns about exposing not only individual habits but also businesses' revenues. In this paper, we first propose a categorization of the existing payment networks formed on top of blockchain backed cryptocurrencies. After discussing several emerging attacks on user business privacy in these payment channel networks, we qualitatively evaluate them based on a number of privacy metrics that relate to our case. Based on the discussions on the strengths and weaknesses of the approaches, we offer possible directions for research for the future of privacy based payment channel networks.


BitextEdit Automatic Bitext Editing for Improved Low Resource Machine Translation. Mined bitexts can contain imperfect translations that yield unreliable training signals for Neural Machine Translation (NMT). While filtering such pairs out is known to improve final model quality, we argue that it is suboptimal in low resource conditions where even mined data can be limited. In our work, we propose instead, to refine the mined bitexts via automatic editing given a sentence in a language xf, and a possibly imperfect translation of it xe, our model generates a revised version xf' or xe' that yields a more equivalent translation pair (i.e., xf, xe' or xf', xe ). We use a simple editing strategy by (1) mining potentially imperfect translations for each sentence in a given bitext, (2) learning a model to reconstruct the original translations and translate, in a multi task fashion. Experiments demonstrate that our approach successfully improves the quality of CCMatrix mined bitext for 5 low resource language pairs and 10 translation directions by up to 8 BLEU points, in most cases improving upon a competitive back translation baseline.


Root polytopes and Jaeger type dissections for directed graphs. We associate root polytopes to directed graphs and study them by using ribbon structures. Most attention is paid to what we call the semi balanced case, i.e., when each cycle has the same number of edges pointing in the two directions. Given a ribbon structure, we identify a natural class of spanning trees and show that, in the semi balanced case, they induce a shellable dissection of the root polytope into maximal simplices. This allows for a computation of the h vector of the polytope and for showing some properties of this new graph invariant, such as a product formula and that in the planar case, the h vector is equivalent to the greedoid polynomial of the dual graph. We obtain a general recursion relation as well. We also work out the case of layer complete directed graphs, where our method recovers a previously known triangulation. Indeed our dissection is often but not always a triangulation we address this with a series of examples.


Evolution of emotion semantics. Humans possess the unique ability to communicate emotions through language. Although concepts like anger or awe are abstract, there is a shared consensus about what these English emotion words mean. This consensus may give the impression that their meaning is static, but we propose this is not the case. We cannot travel back to earlier periods to study emotion concepts directly, but we can examine text corpora, which have partially preserved the meaning of emotion words. Using natural language processing of historical text, we found evidence for semantic change in emotion words over the past century and that varying rates of change were predicted in part by an emotion concept's prototypicality how representative it is of the broader category of "emotion". Prototypicality negatively correlated with historical rates of emotion semantic change obtained from text based word embeddings, beyond more established variables including usage frequency in English and a second comparison language, French. This effect for prototypicality did not consistently extend to the semantic category of birds, suggesting its relevance for predicting semantic change may be category dependent. Our results suggest emotion semantics are evolving over time, with prototypical emotion words remaining semantically stable, while other emotion words evolve more freely.


Factors influencing Drug Consumption and Prediction Methods. Estimating the needs of healthcare products and inventory management are still challenging issues in hospitals nowadays. Centers are supposed to cope with tight budgets and patient satisfaction at the same time. Some issues can be tackled in advance, especially regarding the prediction of drug consumption needs. This work delves into the literature in order to highlight existing methods of quantifying and estimating the needs for drugs in health facilities. A second objective is to draw up a list of factors that impact drug consumption in particular, factors that are used in these prediction methods. Following this literature review, it appears that six sustainable methods are being used by practitioners around the world, taking into account certain prerequisites and types of data. Thirty four factors are identified as well and grouped into three categories. These results should participate in setting up new tools for predicting the need of drugs, to facilitate the upstream dimensioning of new pharmaceutical warehouses and to solve some hospital logistics issues.


The k mappability problem revisited. The k mappability problem has two integers parameters m and k . For every subword of size m in a text S , we wish to report the number of indices in S in which the word occurs with at most k mismatches. The problem was lately tackled by Alzamel et al. For a text with constant alphabet Sigma and k in O(1) , they present an algorithm with linear space and O(n log k 1 n) time. For the case in which k 1 and a constant size alphabet, a faster algorithm with linear space and O(n log(n) log log(n)) time was presented in a 2020 paper by Alzamel et al. In this work, we enhance the techniques of Alzamel et al.'s 2020 paper to obtain an algorithm with linear space and O(n log(n)) time for k 1 . Our algorithm removes the constraint of the alphabet being of constant size. We also present linear algorithms for the case of k 1 , Sigma in O(1) and m Omega( sqrt n ) .


Market Design for Drone Traffic Management. The rapid development of drone technology is leading to more and more use cases being proposed. In response, regulators are drawing up drone traffic management frameworks. However, to design solutions that are efficient, fair, simple, non manipulable, and scalable, we need market design and AI expertise. To this end, we introduce the drone traffic management problem as a new research challenge to the market design and AI communities. We present five design desiderata that we have derived from our interviews with stakeholders from the regulatory side as well as from public and private enterprises. Finally, we provide an overview of the solution space to point out possible directions for future research.


European Longitude Prizes. IV. Thomas Axe's Impossible Terms. Although governments across Europe had realised the need to incentivise the development of practically viable longitude solutions as early as the late sixteenth century, the English government was late to the party. An sense of urgency among the scientific community and maritime navigators led to the establishment of a number of longitude awards by private donors. The first private British award was bequeathed in 1691 by Thomas Axe, parish clerk of Ottery St. Mary (Devon). Despite the absence of an expenses component and the onerous and costly nature of its terms and conditions, the Axe prize attracted a number of optimistic claimants. Although the award was never disbursed, it may have contributed to the instigation of the government supported monetary reward associated with the British Longitude Act of 1714. It is likely that the conditions governing the British "Longitude Prize", specifically the required accuracy and the need for sea trials and of disclosure of a successful method's theoretical principles, can be traced back at least in part to the Axe Prize requirements.