The mysteries of the best approximation and Chebyshev expansion for the function with logarithmic regularities. The best polynomial approximation and Chebyshev approximation are both important in numerical analysis. In tradition, the best approximation is regarded as more better than the Chebyshev approximation, because it is usually considered in the uniform norm. However, it not always superior to the latter noticed by Trefethen cite Trefethen11sixmyths,Trefethen2020 for the algebraic singularity function. Recently Wang cite Wang2021best have proved it in theory. In this paper, we find that for the functions with logarithmic regularities, the pointwise errors of Chebyshev approximation are smaller than the ones of the best approximations except only in the very narrow boundaries at the same degree. The pointwise error for Chebyshev series, truncated at the degree n is O(n kappa ) ( kappa min 2 gamma 1, 2 delta 1 ), but is worse by one power of n in narrow boundary layer near the weak singular endpoints. Theorems are given to explain this effect.


CounterNet End to End Training of Counterfactual Aware Predictions. This work presents CounterNet, a novel end to end learning framework which integrates Machine Learning (ML) model training and the generation of corresponding counterfactual (CF) explanations into a single end to end pipeline. Counterfactual explanations offer a contrastive case, i.e., they attempt to find the smallest modification to the feature values of an instance that changes the prediction of the ML model on that instance to a predefined output. Prior techniques for generating CF explanations suffer from two major limitations (i) they generate CF explanations by solving separate time intensive optimization problems for every single input instance (which slows their running time) and (ii) they are post hoc methods which are designed for use with proprietary black box ML models as a result, their procedure for generating CF explanations is uninformed by the training procedure of the black box ML model, which leads to misalignment of objectives between model predictions and explanations. These two limitations result in significant shortcomings in the quality of the generated CF explanations. CounterNet, on the other hand, integrates both prediction and explanation in the same framework, which enables the optimization of the CF explanation generation only once together with the predictive model. We adopt a theoretically sound block wise coordinate descent procedure which helps in effectively training CounterNet's network architecture. Finally, we evaluate CounterNet's performance by conducting extensive experiments on multiple real world datasets. Our results show that CounterNet generates high quality predictions, and corresponding CF explanations (with well balanced cost invalidity trade offs) for any new input instance significantly faster than existing state of the art baselines.


AVATAR A Parallel Corpus for Java Python Program Translation. Program translation refers to migrating source code from one programming language to another. It has a tremendous practical value in software development as porting software across different languages is time consuming and costly. Automating program translation is of paramount importance in software migration, and recently researchers explored unsupervised approaches due to the unavailability of parallel corpora. However, the availability of pre trained language models for programming languages enable supervised fine tuning with a small amount of labeled examples. In this work, we present a corpus of 8,475 programming problems and their solutions written in two popular languages, Java and Python. We collect the dataset from competitive programming sites, online platforms, and open source repositories. We present several baselines, including models trained from scratch or pre trained on large scale source code collection and fine tuned on our proposed dataset. Experiment results show that while the models perform relatively well in terms of the lexical match, they lack in generating code that is accurate in terms of syntax and data flow match.


Analytical and computational study of the variable inverse sum deg index. A large number of graph invariants of the form sum uv in E(G) F(d u,d v) are studied in mathematical chemistry, where uv denotes the edge of the graph G connecting the vertices u and v , and d u is the degree of the vertex u . Among them the variable inverse sum deg index ISD a , with F(d u,d v) 1 (d u a d v a) , was found to have applicative properties. The aim of this paper is to obtain new inequalities for the variable inverse sum deg index, and to characterize graphs extremal with respect to them. Some of these inequalities generalize and improve previous results for the inverse sum deg index. In addition, we computationally validate some of the obtained inequalities on ensembles of random graphs and show that the ratio left langle ISD a(G) right rangle n ( n being the order of the graph) depends only on the average degree left langle d right rangle .


Involution Inverting the Inherence of Convolution for Visual Recognition. Convolution has been the core ingredient of modern neural networks, triggering the surge of deep learning in vision. In this work, we rethink the inherent principles of standard convolution for vision tasks, specifically spatial agnostic and channel specific. Instead, we present a novel atomic operation for deep neural networks by inverting the aforementioned design principles of convolution, coined as involution. We additionally demystify the recent popular self attention operator and subsume it into our involution family as an over complicated instantiation. The proposed involution operator could be leveraged as fundamental bricks to build the new generation of neural networks for visual recognition, powering different deep learning models on several prevalent benchmarks, including ImageNet classification, COCO detection and segmentation, together with Cityscapes segmentation. Our involution based models improve the performance of convolutional baselines using ResNet 50 by up to 1.6 top 1 accuracy, 2.5 and 2.4 bounding box AP, and 4.7 mean IoU absolutely while compressing the computational cost to 66 , 65 , 72 , and 57 on the above benchmarks, respectively. Code and pre trained models for all the tasks are available at https github.com d li14 involution.


Phishing Attacks and Websites Classification Using Machine Learning and Multiple Datasets (A Comparative Analysis). Phishing attacks are the most common type of cyber attacks used to obtain sensitive information and have been affecting individuals as well as organisations across the globe. Various techniques have been proposed to identify the phishing attacks specifically, deployment of machine intelligence in recent years. However, the deployed algorithms and discriminating factors are very diverse in existing works. In this study, we present a comprehensive analysis of various machine learning algorithms to evaluate their performances over multiple datasets. We further investigate the most significant features within multiple datasets and compare the classification performance with the reduced dimensional datasets. The statistical results indicate that random forest and artificial neural network outperform other classification algorithms, achieving over 97 accuracy using the identified features.


The Complexity of Learning Approval Based Multiwinner Voting Rules. We study the PAC learnability of multiwinner voting, focusing on the class of approval based committee scoring (ABCS) rules. These are voting rules applied on profiles with approval ballots, where each voter approves some of the candidates. ABCS rules adapt positional scoring rules in single winner voting by assuming that each committee of k candidates collects from each voter a score, that depends on the size of the voter's ballot and on the size of its intersection with the committee. Then, committees of maximum score are the winning ones. Our goal is to learn a target rule (i.e., to learn the corresponding scoring function) using information about the winning committees of a small number of sampled profiles. Despite the existence of exponentially many outcomes compared to single winner elections, we show that the sample complexity is still low a polynomial number of samples carries enough information for learning the target committee with high confidence and accuracy. Unfortunately, even simple tasks that need to be solved for learning from these samples are intractable. We prove that deciding whether there exists some ABCS rule that makes a given committee winning in a given profile is a computationally hard problem. Our results extend to the class of sequential Thiele rules, which have received attention due to their simplicity.


Measuring the Non Transitivity in Chess. It has long been believed that Chess is the emph Drosophila of Artificial Intelligence (AI). Studying Chess can productively provide valid knowledge about complex systems. Although remarkable progress has been made on solving Chess, the geometrical landscape of Chess in the strategy space is still mysterious. Judging on AI generated strategies, researchers hypothesised that the strategy space of Chess possesses a spinning top geometry, with the upright axis representing the emph transitive dimension (e.g., A beats B, B beats C, A beats C), and the radial axis representing the emph non transitive dimension (e.g., A beats B, B beats C, C beats A). However, it is unclear whether such a hypothesis holds for real world strategies. In this paper, we quantify the non transitivity in Chess through real world data from human players. Specifically, we performed two ways of non transitivity quantifications Nash Clustering and counting the number of Rock Paper Scissor cycles on over one billion match data from Lichess and FICS. Our findings positively indicate that the strategy space occupied by real world Chess strategies demonstrates a spinning top geometry, and more importantly, there exists a strong connection between the degree of non transitivity and the progression of a Chess player's rating. In particular, high degrees of non transitivity tend to prevent human players from making progress on their Elo rating, whereas progressions are easier to make at the level of ratings where the degree of non transitivity is lower. Additionally, we also investigate the implication of the degree of non transitivity for population based training methods. By considering emph fixed memory Fictitious Play as a proxy, we reach the conclusion that maintaining large size and diverse populations of strategies is imperative to training effective AI agents in solving Chess types of games.


Systems of Dyadic Cubes of Complete, Doubling, Uniformly Perfect Metric Spaces without Detours. Systems of dyadic cubes are the basic tools of harmonic analysis and geometry, and this notion had been extended to general metric spaces. In this paper, we construct systems of dyadic cubes of complete, doubling, uniformly perfect metric spaces, such that for any two points in the metric space, there exists a chain of three cubes whose diameters are comparable to the distance of the points. We also give an application of our construction to previous research of potential analysis and geometry of metric spaces.


Video Salient Object Detection via Adaptive Local Global Refinement. Video salient object detection (VSOD) is an important task in many vision applications. Reliable VSOD requires to simultaneously exploit the information from both the spatial domain and the temporal domain. Most of the existing algorithms merely utilize simple fusion strategies, such as addition and concatenation, to merge the information from different domains. Despite their simplicity, such fusion strategies may introduce feature redundancy, and also fail to fully exploit the relationship between multi level features extracted from both spatial and temporal domains. In this paper, we suggest an adaptive local global refinement framework for VSOD. Different from previous approaches, we propose a local refinement architecture and a global one to refine the simply fused features with different scopes, which can fully explore the local dependence and the global dependence of multi level features. In addition, to emphasize the effective information and suppress the useless one, an adaptive weighting mechanism is designed based on graph convolutional neural network (GCN). We show that our weighting methodology can further exploit the feature correlations, thus driving the network to learn more discriminative feature representation. Extensive experimental results on public video datasets demonstrate the superiority of our method over the existing ones.


SAM A Self adaptive Attention Module for Context Aware Recommendation System. Recently, textual information has been proved to play a positive role in recommendation systems. However, most of the existing methods only focus on representation learning of textual information in ratings, while potential selection bias induced by the textual information is ignored. In this work, we propose a novel and general self adaptive module, the Self adaptive Attention Module (SAM), which adjusts the selection bias by capturing contextual information based on its representation. This module can be embedded into recommendation systems that contain learning components of contextual information. Experimental results on three real world datasets demonstrate the effectiveness of our proposal, and the state of the art models with SAM significantly outperform the original ones.


Risk sensitive Markov decision problems under model uncertainty finite time horizon case. In this paper we study a class of risk sensitive Markovian control problems in discrete time subject to model uncertainty. We consider a risk sensitive discounted cost criterion with finite time horizon. The used methodology is the one of adaptive robust control combined with machine learning.


Bayes Optimal Convolutional AMP. To improve the convergence property of approximate message passing (AMP), convolutional AMP (CAMP) has been proposed. CAMP replaces the Onsager correction in AMP with a convolution of messages in all preceding iterations while it uses the same low complexity matched filter (MF) as AMP. This paper derives state evolution (SE) equations to design the Bayes optimal denoiser in CAMP. Numerical results imply that CAMP with the Bayes optimal denoiser called Bayes optimal CAMP can achieve the Bayes optimal performance for right orthogonally invariant sensing matrices with low to moderate condition numbers.


Offline Meta Reinforcement Learning for Industrial Insertion. Reinforcement learning (RL) can in principle let robots automatically adapt to new tasks, but current RL methods require a large number of trials to accomplish this. In this paper, we tackle rapid adaptation to new tasks through the framework of meta learning, which utilizes past tasks to learn to adapt with a specific focus on industrial insertion tasks. Fast adaptation is crucial because prohibitively large number of on robot trials will potentially damage hardware pieces. Additionally, effective adaptation is also feasible in that experience among different insertion applications can be largely leveraged by each other. In this setting, we address two specific challenges when applying meta learning. First, conventional meta RL algorithms require lengthy online meta training. We show that this can be replaced with appropriately chosen offline data, resulting in an offline meta RL method that only requires demonstrations and trials from each of the prior tasks, without the need to run costly meta RL procedures online. Second, meta RL methods can fail to generalize to new tasks that are too different from those seen at meta training time, which poses a particular challenge in industrial applications, where high success rates are critical. We address this by combining contextual meta learning with direct online finetuning if the new task is similar to those seen in the prior data, then the contextual meta learner adapts immediately, and if it is too different, it gradually adapts through finetuning. We show that our approach is able to quickly adapt to a variety of different insertion tasks, with a success rate of 100 using only a fraction of the samples needed for learning the tasks from scratch. Experiment videos and details are available at https sites.google.com view offline metarl insertion.


Dedekind on Higher Congruences and Index Divisors, 1871 and 1878. Dedekind's theorem connecting ideal theory and polynomial congruences appears in all textbooks on algebraic number theory, but few books note its connection to the problem of common index divisors.'' As part of a project to study the history of this problem, we present an annotated translation of two of Dedekind's papers on the subject a notice about the first publication of Dedekind's ideal theory in 1871 and a paper of 1878 giving proofs of the results announced in 1871 and giving a necessary and sufficient condition for the existence of common index divisors. A separate paper will analyze Hensel's 1894 paper containing the same theorem.


Product and Quotient rule for Ward's differential calculus. In this paper we obtain a rule for the derivative of the product and quotient of psi exponential generating functions for a Ward calculus. The main idea is to define a C algebra of Fontan 'e products defined on a psi ring of Ward which is compatible with the ordinary calculus and with the q calculus and then obtain the above rules. In addition, we obtain a general Leibniz rule by means of defining a binomial operator which is the analogue of the binomial coefficients.


Detecting mid infrared light by molecular frequency upconversion with dual wavelength hybrid nanoantennas. Coherent interconversion of signals between optical and mechanical domains is enabled by optomechanical interactions. Extreme light matter coupling produced by confining light to nanoscale mode volumes can then access single mid infrared (MIR) photon sensitivity. Here we utilise the infrared absorption and Raman activity of molecular vibrations in plasmonic nanocavities to demonstrate frequency upconversion. We convert lambda 10 mu m incoming light to visible via surface enhanced Raman scattering (SERS) in doubly resonant antennas that enhance upconversion by 10 10. We show 200 amplification of the SERS antiStokes emission when a MIR pump is tuned to a molecular vibrational frequency, obtaining lowest detectable powers 1 mu W mu m 2 at room temperature. These results have potential for low cost and large scale infrared detectors and spectroscopic techniques, and bring single molecule sensing into the infrared


Small Promise CSPs that reduce to large CSPs. For relational structures A, B of the same signature, the Promise Constraint Satisfaction Problem PCSP(A,B) asks whether a given input structure maps homomorphically to A or does not even map to B. We are promised that the input satisfies exactly one of these two cases. If there exists a structure C with homomorphisms A to C to B , then PCSP(A,B) reduces naturally to CSP(C). To the best of our knowledge all known tractable PCSPs reduce to tractable CSPs in this way. However Barto showed that some PCSPs over finite structures A, B require solving CSPs over infinite C. We show that even when such a reduction to finite C is possible, this structure may become arbitrarily large. For every integer n 1 and every prime p we give A, B of size n with a single relation of arity n p such that PCSP(A, B) reduces via a chain of homomorphisms A to C to B to a tractable CSP over some C of size p but not over any smaller structure. In a second family of examples, for every prime p geq 7 we construct A, B of size p 1 with a single ternary relation such that PCSP(A, B) reduces via A to C to B to a tractable CSP over some C of size p but not over any smaller structure. In contrast we show that if A, B are graphs and PCSP(A,B) reduces to tractable CSP(C) for some finite digraph C, then already A or B has a tractable CSP. This extends results and answers a question of Deng et al.


Bridging the neuroscience and physics of time. As a neuroscientist and a theoretical physicist, both working on time, we have decided to open a direct dialogue to examine if the apparent discrepancies regarding the nature of time can be composed.


Local and Global Context Based Pairwise Models for Sentence Ordering. Sentence Ordering refers to the task of rearranging a set of sentences into the appropriate coherent order. For this task, most previous approaches have explored global context based end to end methods using Sequence Generation techniques. In this paper, we put forward a set of robust local and global context based pairwise ordering strategies, leveraging which our prediction strategies outperform all previous works in this domain. Our proposed encoding method utilizes the paragraph's rich global contextual information to predict the pairwise order using novel transformer architectures. Analysis of the two proposed decoding strategies helps better explain error propagation in pairwise models. This approach is the most accurate pure pairwise model and our encoding strategy also significantly improves the performance of other recent approaches that use pairwise models, including the previous state of the art, demonstrating the research novelty and generalizability of this work. Additionally, we show how the pre training task for ALBERT helps it to significantly outperform BERT, despite having considerably lesser parameters. The extensive experimental results, architectural analysis and ablation studies demonstrate the effectiveness and superiority of the proposed models compared to the previous state of the art, besides providing a much better understanding of the functioning of pairwise models.


Large Eddy Simulations and modal reconstruction of laminar transonic buffet. Transonic buffet refers to the self sustained periodic motion of shock waves observed in transonic flows over wings and limits the flight envelope of aircraft. Based on the boundary layer characteristics at the shock foot, buffet has been classified as laminar or turbulent and the mechanisms underlying the two have been proposed to be different (Dandois et al., 2018, J. Fluid Mech., vol. 18, pp. 156 178). The effect of various flow parameters (freestream Mach and Reynolds numbers and sweep and incidence angles) on laminar transonic buffet on an infinite wing (Dassault Aviation's supercritical V2C aerofoil) is reported here by performing Large Eddy Simulations (LES) for a wide range of parameters. A spectral proper orthogonal decomposition identified the presence of a low frequency mode associated with buffet and high frequency wake modes related to vortex shedding. A flow reconstruction based only on the former shows periodic boundary layer separation and reattachment accompanying shock wave motion. A modal reconstruction based only on the wake mode suggests that the separation bubble breathing phenomenon reported by Dandois et al. is due to this mode. Together, these results indicate that the physical mechanisms governing laminar and turbulent buffet are the same. Buffet was also simulated at zero incidence. Shock waves appear on both aerofoil surfaces and oscillate out of phase with each other indicating the occurrence of a Type I buffet (Giannelis et al., 2018, Aerosp. Sci. Technol., vol. 18, pp. 89 101) on a supercritical aerofoil. These results suggest that the mechanisms underlying different buffet types are the same.


On the impact of MDP design for Reinforcement Learning agents in Resource Management. The recent progress in Reinforcement Learning applications to Resource Management presents MDPs without a deeper analysis of the impacts of design decisions on agent performance. In this paper, we compare and contrast four different MDP variations, discussing their computational requirements and impacts on agent performance by means of an empirical analysis. We conclude by showing that, in our experiments, when using Multi Layer Perceptrons as approximation function, a compact state representation allows transfer of agents between environments, and that transferred agents have good performance and outperform specialized agents in 80 of the tested scenarios, even without retraining.


Limiting shape for First Passage Percolation models on Random Geometric Graphs. Let a random geometric graph be defined in the supercritical regime for the existence of a unique infinite connected component in Euclidean space. Consider the first passage percolation model with independent and identically distributed random variables on the random infinite connected component. We provide sufficient conditions for the existence of the asymptotic shape and we show that the shape is an Euclidean ball. We give some examples exhibiting the result for Bernoulli percolation and the Richardson model. For the Richardson model we further show that it converges weakly to a nonstandard branching process in the joint limit of large intensities and slow passing times.


Conditional probing measuring usable information beyond a baseline. Probing experiments investigate the extent to which neural representations make properties like part of speech predictable. One suggests that a representation encodes a property if probing that representation produces higher accuracy than probing a baseline representation like non contextual word embeddings. Instead of using baselines as a point of comparison, we're interested in measuring information that is contained in the representation but not in the baseline. For example, current methods can detect when a representation is more useful than the word identity (a baseline) for predicting part of speech however, they cannot detect when the representation is predictive of just the aspects of part of speech not explainable by the word identity. In this work, we extend a theory of usable information called mathcal V information and propose conditional probing, which explicitly conditions on the information in the baseline. In a case study, we find that after conditioning on non contextual word embeddings, properties like part of speech are accessible at deeper layers of a network than previously thought.


A differential approach to the Ax Schanuel, I. In this paper, we prove several Ax Schanuel type results for uniformizers of geometric structures. In particular, we give a proof of the full Ax Schanuel Theorem with derivatives for uniformizers of any Fuchsian group of the first kind and any genus. Our techniques combine tools from differential geometry, differential algebra and the model theory of differentially closed fields. The proof is very similar in spirit to Ax's proof of the theorem in the case of the exponential function.


Role of Time Reversal Symmetry in the Dynamical Response of "One Way" Nonlinear Devices. We study the role of time reversal symmetry on the dynamical response of nonlinear optical systems that behave as unidirectional ("one way") devices. It is shown that lossless nonlinear materials, despite being nonreciprocal, are typically time reversal invariant. This property raises an apparent paradox because time reversal invariant systems are forcibly bi directional. Here, we present a solution for this conundrum, and theoretically explain why the "one way" behavior can indeed be compatible with the time reversal invariance. It is found that in the time reversed problem the incident waves have a variation in time that is generally incompatible with the adiabatic approximation. Due to this reason the adiabatic approximation fails to predict the bi directional nature of nonlinear system. We discuss the implications of this finding in the performance of practical nonlinear "one way" devices.


Gradual Domain Adaptation in the Wild When Intermediate Distributions are Absent. We focus on the problem of domain adaptation when the goal is shifting the model towards the target distribution, rather than learning domain invariant representations. It has been shown that under the following two assumptions (a) access to samples from intermediate distributions, and (b) samples being annotated with the amount of change from the source distribution, self training can be successfully applied on gradually shifted samples to adapt the model toward the target distribution. We hypothesize having (a) is enough to enable iterative self training to slowly adapt the model to the target distribution, by making use of an implicit curriculum. In the case where (a) does not hold, we observe that iterative self training falls short. We propose GIFT, a method that creates virtual samples from intermediate distributions by interpolating representations of examples from source and target domains. We evaluate an iterative self training method on datasets with natural distribution shifts, and show that when applied on top of other domain adaptation methods, it improves the performance of the model on the target dataset. We run an analysis on a synthetic dataset to show that in the presence of (a) iterative self training naturally forms a curriculum of samples. Furthermore, we show that when (a) does not hold, GIFT performs better than iterative self training.


Event based Timestamp Image Encoding Network for Human Action Recognition and Anticipation. Event camera is an asynchronous, high frequency vision sensor with low power consumption, which is suitable for human action understanding task. It is vital to encode the spatial temporal information of event data properly and use standard computer vision tool to learn from the data. In this work, we propose a timestamp image encoding 2D network, which takes the encoded spatial temporal images with polarity information of the event data as input and output the action label. In addition, we propose a future timestamp image generator to generate futureaction information to aid the model to anticipate the human action when the action is not completed. Experiment results show that our method can achieve the same level of performance as those RGB based benchmarks on real world action recognition,and also achieve the state of the art (SOTA) result on gesture recognition. Our future timestamp image generating model can effectively improve the prediction accuracy when the action is not completed. We also provide insight discussion on the importance of motion and appearance information in action recognition and anticipation.


Expectable Motion Unit Avoiding Hazards From Human Involuntary Motions in Human Robot Interaction. In robotics, many control and planning schemes have been developed that ensure the human physical safety in human robot interaction. The human psychological state and expectation towards the robot, however, are typically neglected. Even if the robot behaviour is regarded as biomechanically safe, humans may still react with rapid involuntary motion (IM) caused by startle or surprise. Obviously, such sudden, uncontrolled motions can jeopardize safety and should be prevented by any means. In this paper, we propose the Expectable Motion Unit (EMU) concept which ensures that a certain probability of IM occurrence is not exceeded in a typical HRI setting. Based on a model of IM occurrence that we generate through an experiment with 29 participants, the mapping between robot velocity, robot human distance, and the relative frequency of IM occurrence is established. This mapping is processed towards a real time capable robot motion generator, which limits the robot velocity during task execution if necessary. The EMU is combined with the well established Safe Motion Unit in order to integrate both physical and psychological safety knowledge and data into a holistic safety framework. In a validation experiment, it was shown that the EMU successfully avoids human IM in five out of six cases.


Shifting Mobility Behaviors in Unprecedented Times Intentions to Use On demand Ride Services During the COVID 19 Pandemic. The spread of COVID 19 has been a major disruptive force in people's everyday lives and mobility behavior. The demand for on demand ride services, such as taxis and ridehailing has been specifically impacted, given both restrictions in service operations and user's concerns about virus transmission in shared vehicles. During the pandemic, demand for these modes have decreased by as much as 80 . This study examines intentions to use on demand ride services in a period of drastic changes in lifestyles and daily routines coupled with unprecedented mobility reductions. Specifically, we examine the determinants for the shift of intentions to use these on demand modes of travel in the early stages of the pandemic. Using data from a survey disseminated in June 2020 to 700 respondents from contiguous United States, ordinal regression modeling is applied to analyze the shift in consideration. The results indicate that political orientation and health related experiences during the pandemic are significant sources of variation for individual changes in intentions to use ridehailing. Additionally, characteristics such as age and income result in consideration shifts that contradict the typical ridership profiles found in the ridehailing literature. Specifically, on demand ride consideration decreases as a function of age and income. Moreover, transit users are more willing to consider on demand rides than private vehicle users, suggesting that shared vehicle modes have a similar risk profile. We discuss the role of on demand ride services in the pandemic era, and the need to investigate political orientation and evolving pandemic experiences to pinpoint their role in future mobility systems.


Towards Very Low Cost Iterative Prototyping for Fully Printable Dexterous Soft Robotic Hands. The design and fabrication of soft robot hands is still a time consuming and difficult process. Advances in rapid prototyping have accelerated the fabrication process significantly while introducing new complexities into the design process. In this work, we present an approach that utilizes novel low cost fabrication techniques in conjunction with design tools helping soft hand designers to systematically take advantage of multi material 3D printing to create dexterous soft robotic hands. While very low cost and lightweight, we show that generated designs are highly durable, surprisingly strong, and capable of dexterous grasping.


Towards van der Waerden's conjecture. How often is a quintic polynomial solvable by radicals? We establish that the number of such polynomials, monic and irreducible with integer coefficients in H,H , is O(H 3.91 ) . More generally, we show that if n ge 3 and n notin 7, 8, 10 then there are O(H n 1.017 ) monic, irreducible polynomials of degree n with integer coefficients in H,H and Galois group not containing A n . Save for the alternating group and degrees 7,8,10 , this establishes a 1936 conjecture of van der Waerden.


Towards Feature Based Performance Regression Using Trajectory Data. Black box optimization is a very active area of research, with many new algorithms being developed every year. This variety is needed, on the one hand, since different algorithms are most suitable for different types of optimization problems. But the variety also poses a meta problem which algorithm to choose for a given problem at hand? Past research has shown that per instance algorithm selection based on exploratory landscape analysis (ELA) can be an efficient mean to tackle this meta problem. Existing approaches, however, require the approximation of problem features based on a significant number of samples, which are typically selected through uniform sampling or Latin Hypercube Designs. The evaluation of these points is costly, and the benefit of an ELA based algorithm selection over a default algorithm must therefore be significant in order to pay off. One could hope to by pass the evaluations for the feature approximations by using the samples that a default algorithm would anyway perform, i.e., by using the points of the default algorithm's trajectory. We analyze in this paper how well such an approach can work. Concretely, we test how accurately trajectory based ELA approaches can predict the final solution quality of the CMA ES after a fixed budget of function evaluations. We observe that the loss of trajectory based predictions can be surprisingly small compared to the classical global sampling approach, if the remaining budget for which solution quality shall be predicted is not too large. Feature selection, in contrast, did not show any advantage in our experiments and rather led to worsened prediction accuracy. The inclusion of state variables of CMA ES only has a moderate effect on the prediction accuracy.


A Comparison of Code Embeddings and Beyond. Program representation learning is a fundamental task in software engineering applications. With the availability of "big code" and the development of deep learning techniques, various program representation learning models have been proposed to understand the semantic properties of programs and applied on different software engineering tasks. However, no previous study has comprehensively assessed the generalizability of these deep models on different tasks, so that the pros and cons of the models are unclear. In this experience paper, we try to bridge this gap by systemically evaluating the performance of eight program representation learning models on three common tasks, where six models are based on abstract syntax trees and two models are based on plain text of source code. We kindly explain the criteria for selecting the models and tasks, as well as the method for enabling end to end learning in each task. The results of performance evaluation show that they perform diversely in each task and the performance of the AST based models is generally unstable over different tasks. In order to further explain the results, we apply a prediction attribution technique to find what elements are captured by the models and responsible for the predictions in each task. Based on the findings, we discuss some general principles for better capturing the information in the source code, and hope to inspire researchers to improve program representation learning methods for software engineering tasks.


Recommendations to clarify NASA open source requirements. The software community has specific definitions for terms such as "open source software," "free software," and "permissive license," but scientists proposing software development efforts to NASA are not always knowledgeable about these definitions. Misunderstandings about the meaning of these terms can result in problems of fairness with solicitations, because scientists who interpret the terms differently than NASA intends may either needlessly limit the scope of their proposed work, or unwittingly propose work that does not comply with software licensing requirements. It is therefore recommended that NASA adopt definitions of the above terms that are in line with software community usage, that these definitions be communicated as part of solicitations to ensure a common understanding, and that proposals be required to identify what software licenses the proposers expect to use.


Seaweed Algebras and the Index Statistic for Partitions. In 2018 Coll, Mayers, and Mayers conjectured that the q series ( q, q 3 q 4 ) infty 1 is the generating function for a certain parity statistic related to the index of seaweed algebras. We prove this conjecture. Thanks to earlier work by Seo and Yee, the conjecture would follow from the non negativity of the coefficients of this infinite product. Using a variant of the circle method along with Euler Maclaurin summation, we establish this non negativity, thereby confirming the Coll Mayers Mayers Conjecture.


Utility indifference Option Pricing Model with a Non Constant Risk Aversion under Transaction Costs and Its Numerical Approximation. Our goal is to analyze the system of Hamilton Jacobi Bellman equations arising in derivative securities pricing models. The European style of an option price is constructed as a difference of the certainty equivalents to the value functions solving the system of HJB equations. We introduce the transformation method for solving the penalized nonlinear partial differential equation. The transformed equation involves possibly non constant the risk aversion function containing the negative ratio between the second and first derivatives of the utility function. Using comparison principles we derive useful bounds on the option price. We also propose a finite difference numerical discretization scheme with some computational examples.


Exponential Ergodicity for Non Dissipative McKean Vlasov SDEs. Under Lyapunov and monotone conditions, the exponential ergodicity in the induced Wasserstein quasi distance is proved for a class of fully non dissipative McKean Vlasov SDEs, which strengthen some recent results established under dissipative conditions in long distance. Moreover, when the SDE is order preserving, the exponential ergodicity is derived in the Wasserstein distance induced by one dimensional increasing functions chosen according to the coefficients of the equation.


The Public Good index for games with several levels of approval in the input and output. The Public Good index is a power index for simple games introduced by Holler and later axiomatized by Holler and Packel, so that some authors also speak of the Holler Packel index. A generalization to the class of games with transferable utility was given by Holler and Li. Here we generalize the underlying ideas to games with several levels of approval in the input and output so called (j,k) simple games. Corresponding axiomatizations are also provided.


On a fluid structure interaction problem for plaque growth. We study a free boundary fluid structure interaction problem with growth, which arises from the plaque formation in blood vessels. The fluid is described by the incompressible Navier Stokes equation, while the structure is considered as a viscoelastic incompressible neo Hookean material. Moreover, the growth due to the biochemical process is taken into account. Applying the maximal regularity theory to a linearization of the equations, along with a deformation mapping, we prove the well posedness of the full nonlinear problem via the contraction mapping principle.


The NiuTrans System for the WMT21 Efficiency Task. This paper describes the NiuTrans system for the WMT21 translation efficiency task (http statmt.org wmt21 efficiency task.html). Following last year's work, we explore various techniques to improve efficiency while maintaining translation quality. We investigate the combinations of lightweight Transformer architectures and knowledge distillation strategies. Also, we improve the translation efficiency with graph optimization, low precision, dynamic batching, and parallel pre post processing. Our system can translate 247,000 words per second on an NVIDIA A100, being 3 times faster than last year's system. Our system is the fastest and has the lowest memory consumption on the GPU throughput track. The code, model, and pipeline will be available at NiuTrans.NMT (https github.com NiuTrans NiuTrans.NMT).


Projection methods for high numerical aperture phase retrieval. We develop for the first time a mathematical framework in which the class of projection algorithms can be applied to high numerical aperture (NA) phase retrieval. Within this framework, we first analyze the basic steps of solving the high NA phase retrieval problem by projection algorithms and establish the closed forms of all the relevant prox operators. We then study the geometry of the high NA phase retrieval problem and the obtained results are subsequently used to establish convergence criteria of projection algorithms in the presence of noise. Making use of the vectorial point spread function (PSF) is, on the one hand, the key difference between this paper and the literature of phase retrieval mathematics which deals with the scalar PSF. The results of this paper, on the other hand, can be viewed as extensions of those concerning projection methods for low NA phase retrieval. Importantly, the improved performance of projection methods over the other classes of phase retrieval algorithms in the low NA setting now also becomes applicable to the high NA case. This is demonstrated by the accompanying numerical results which show that available solution approaches for high NA phase retrieval are outperformed by projection methods.


Transformer in Transformer. Transformer is a new kind of neural architecture which encodes the input data as powerful features via the attention mechanism. Basically, the visual transformers first divide the input images into several local patches and then calculate both representations and their relationship. Since natural images are of high complexity with abundant detail and color information, the granularity of the patch dividing is not fine enough for excavating features of objects in different scales and locations. In this paper, we point out that the attention inside these local patches are also essential for building visual transformers with high performance and we explore a new architecture, namely, Transformer iN Transformer (TNT). Specifically, we regard the local patches (e.g., 16 times 16) as "visual sentences" and present to further divide them into smaller patches (e.g., 4 times 4) as "visual words". The attention of each word will be calculated with other words in the given visual sentence with negligible computational costs. Features of both words and sentences will be aggregated to enhance the representation ability. Experiments on several benchmarks demonstrate the effectiveness of the proposed TNT architecture, e.g., we achieve an 81.5 top 1 accuracy on the ImageNet, which is about 1.7 higher than that of the state of the art visual transformer with similar computational cost. The PyTorch code is available at https github.com huawei noah CV Backbones, and the MindSpore code is available at https gitee.com mindspore models tree master research cv TNT.


NoisFre Noise Tolerant Memory Fingerprints from Commodity Devices for Security Functions. Given the ubiquity of memory in commodity electronic devices, fingerprinting memory is a compelling proposition, especially for low end Internet of Things (IoT) devices where cryptographic modules are often unavailable. However, the use of fingerprints in security functions is challenged by the inexact reproductions of fingerprints from the same device at different time instances due to various noise sources causing, small, but unpredictable variations in fingerprint measurements. Our study formulates a novel and textit pragmatic approach to achieve the elusive goal of affording highly reliable fingerprints from device memories. We investigate the transformation of raw fingerprints into a noise tolerant space where the generation of fingerprints from memory biometrics is intrinsically highly reliable. Further, we derive formal performance bounds to support practitioners to adopt our methods for practical applications. Subsequently, we demonstrate the expressive power of our formalization by using it to investigate the practicability of extracting noise tolerant fingerprints from commodity devices. We have employed a set of 38 memory chips including SRAM (69,206,016 cells), Flash (3,902,976 cells) and EEPROM (32,768 cells) ubiquitously embedded in low end commodity devices from 6 different manufacturers for extensive experimental validations. Our results demonstrate that noise tolerant fingerprints achieving a key failure rate less than 10 6 can always be efficiently afforded from tested memories with a solely fingerprint snap shot enrollment. Further, we employ a low cost wearable Bluetooth inertial sensor and demonstrate a practical, end to end implementation of a remote attestation security function built upon a root key from noise tolerant SRAM fingerprints generated on demand and at run time.


An involution on derangements preserving excedances and right to left minima. We give a bijective proof of a result by R. Mantaci and F. Rakotondrajao from 2003, regarding even and odd derangement with a fixed number of excedances. We refine this result by also considering the set of right to left minima.


Counterexamples to a rigidity conjecture. We discuss several counterexamples to a rigidity conjecture of K. Khanin, which states that under some quantitative condition on non existence of periodic orbits, C 0 conjugacy implies C 1 (even C infty ) conjugacy. We construct examples of non rigid diffeomorphisms on the 2 torus, which satisfy the assumptions of Khanin's (but not of Krikorian's) conjecture. We also construct examples of flows which are topologically conjugate, but not C 1 conjugate, in contradiction to a natural generalization of the conjecture to flows. These latter examples are based on results on solutions of the cohomological equation and suggest that the structure of the space of invariant distributions has to be taken into account in rigidity questions.


Weakly distance regular digraphs of one type of arcs. In this paper, we classify all commutative weakly distance regular digraphs of girth g and one type of arcs under the assumption that p (1,g 1),(1,g 1) (2,g 2) geq k 1,g 1 2 . In consequence, we recover 13, Theorem 1.1 as a special case of our result.


Measuring the Contribution of Multiple Model Representations in Detecting Adversarial Instances. Deep learning models have been used for a wide variety of tasks. They are prevalent in computer vision, natural language processing, speech recognition, and other areas. While these models have worked well under many scenarios, it has been shown that they are vulnerable to adversarial attacks. This has led to a proliferation of research into ways that such attacks could be identified and or defended against. Our goal is to explore the contribution that can be attributed to using multiple underlying models for the purpose of adversarial instance detection. Our paper describes two approaches that incorporate representations from multiple models for detecting adversarial examples. We devise controlled experiments for measuring the detection impact of incrementally utilizing additional models. For many of the scenarios we consider, the results show that performance increases with the number of underlying models used for extracting representations.


Five solutions for the fractional p Laplacian with noncoercive energy. We deal with a Dirichlet problem driven by the degenerate fractional p Laplacian and involving a nonlinear reaction which satisfies, among other hypotheses, a (p 1) linear growth at infinity with non resonance above the first eigenvalue. The energy functional governing the problem is thus noncoercive. Thus we focus on the behavior of the reaction near the origin, assuming that it has a (p 1) sublinear growth at zero, vanishes at three points, and satisfies a reverse Ambrosetti Rabinowitz condition. Under such assumptions, by means of critical point theory and Morse theory, and using suitably truncated reactions, we show the existence of five nontrivial solutions two positive, two negative, and one nodal.


Improving state estimation through projection post processing for activity recognition in football. The past decade has seen an increased interest in human activity recognition. Most commonly, the raw data coming from sensors attached to body parts are unannotated, which creates a need for fast labelling method. Part of the procedure is choosing or designing an appropriate performance measure. We propose a new performance measure, the Locally Time Shifted Measure, which addresses the issue of timing uncertainty of state transitions in the classification result. Our main contribution is a novel post processing method for binary activity recognition. It improves the accuracy of the classification methods, by correcting for unrealistically short activities in the estimate.


Estimation of Summary to Text Inconsistency by Mismatched Embeddings. We propose a new reference free summary quality evaluation measure, with emphasis on the faithfulness. The measure is designed to find and count all possible minute inconsistencies of the summary with respect to the source document. The proposed ESTIME, Estimator of Summary to Text Inconsistency by Mismatched Embeddings, correlates with expert scores in summary level SummEval dataset stronger than other common evaluation measures not only in Consistency but also in Fluency. We also introduce a method of generating subtle factual errors in human summaries. We show that ESTIME is more sensitive to subtle errors than other common evaluation measures.


Similarity Contrastive Estimation for Self Supervised Soft Contrastive Learning. Contrastive representation learning has proven to be an effective self supervised learning method. Most successful approaches are based on the Noise Contrastive Estimation (NCE) paradigm and consider different views of an instance as positives and other instances as noise that positives should be contrasted with. However, all instances in a dataset are drawn from the same distribution and share underlying semantic information that should not be considered as noise. We argue that a good data representation contains the relations, or semantic similarity, between the instances. Contrastive learning implicitly learns relations but considers the negatives as noise which is harmful to the quality of the learned relations and therefore the quality of the representation. To circumvent this issue we propose a novel formulation of contrastive learning using semantic similarity between instances called Similarity Contrastive Estimation (SCE). Our training objective can be considered as soft contrastive learning. Instead of hard classifying positives and negatives, we propose a continuous distribution to push or pull instances based on their semantic similarities. The target similarity distribution is computed from weak augmented instances and sharpened to eliminate irrelevant relations. Each weak augmented instance is paired with a strong augmented instance that contrasts its positive while maintaining the target similarity distribution. Experimental results show that our proposed SCE outperforms its baselines MoCov2 and ReSSL on various datasets and is competitive with state of the art algorithms on the ImageNet linear evaluation protocol.


Stabilization Bounds for Influence Propagation from a Random Initial State. We study the stabilization time of two common types of influence propagation. In majority processes, nodes in a graph want to switch to the most frequent state in their neighborhood, while in minority processes, nodes want to switch to the least frequent state in their neighborhood. We consider the sequential model of these processes, and assume that every node starts out from a uniform random state. We first show that if nodes change their state for any small improvement in the process, then stabilization can last for up to Theta(n 2) steps in both cases. Furthermore, we also study the proportional switching case, when nodes only decide to change their state if they are in conflict with a frac 1 lambda 2 fraction of their neighbors, for some parameter lambda in (0,1) . In this case, we show that if lambda frac 1 3 , then there is a construction where stabilization can indeed last for Omega(n 1 c ) steps for some constant c 0 . On the other hand, if lambda frac 1 2 , we prove that the stabilization time of the processes is upper bounded by O(n cdot log n ) .


Hilbert polynomial of length functions. Let L be a general length function for modules over a Noetherian ring R. We use L to define Hilbert series and polynomials for R X modules. The leading term of any such polynomial is an invariant of R X modules, which refines the algebraic entropy.


Brauer tree algebras have binom 2n n 2 tilting complexes. We show that any Brauer tree algebra has precisely binom 2n n 2 tilting complexes, where n is the number of edges of the associated Brauer tree. More explicitly, for an external edge e and an integer j neq0 , we show that the number of 2 tilting complexes T with g e(T) j is binom 2n j 1 n 1 , where g e(T) denotes the e th of the g vector of T . To prove this, we use a geometric model of Brauer graph algebras on the closed oriented marked surfaces and a classification of 2 tilting complexes due to Adachi Aihara Chan.


Robust Text CAPTCHAs Using Adversarial Examples. CAPTCHA (Completely Automated Public Truing test to tell Computers and Humans Apart) is a widely used technology to distinguish real users and automated users such as bots. However, the advance of AI technologies weakens many CAPTCHA tests and can induce security concerns. In this paper, we propose a user friendly text based CAPTCHA generation method named Robust Text CAPTCHA (RTC). At the first stage, the foregrounds and backgrounds are constructed with randomly sampled font and background images, which are then synthesized into identifiable pseudo adversarial CAPTCHAs. At the second stage, we design and apply a highly transferable adversarial attack for text CAPTCHAs to better obstruct CAPTCHA solvers. Our experiments cover comprehensive models including shallow models such as KNN, SVM and random forest, various deep neural networks and OCR models. Experiments show that our CAPTCHAs have a failure rate lower than one millionth in general and high usability. They are also robust against various defensive techniques that attackers may employ, including adversarial training, data pre processing and manual tagging.


Unirationality of RDP Del Pezzo surfaces of degree 2. We study unirationality of a Del Pezzo surface of degree two over a given (non algebraically closed) field, under the assumption that it admits at least one rational double point over an algebraic closure of the base field. As corollaries of our main results, we find that over a finite field, it is unirational if the cardinality of the field is greater than or equal to nine and we also find that over an infinite field, which is not necessarily perfect, it is unirational if and only if the rational points are Zariski dense over the field.


A remark on the quaternionic Monge Amp ere equation on foliated manifolds. We study the quaternionic Monge Amp ere equation on HKT manifolds admitting an HKT foliation having corank 4. We show that in this setting the quaternionic Monge Amp ere equation has always a unique solution for every basic datum. This approach includes the study of the equation on SU(3).


Investigating the Effect of Natural Language Explanations on Out of Distribution Generalization in Few shot NLI. Although neural models have shown strong performance in datasets such as SNLI, they lack the ability to generalize out of distribution (OOD). In this work, we formulate a few shot learning setup and examine the effects of natural language explanations on OOD generalization. We leverage the templates in the HANS dataset and construct templated natural language explanations for each template. Although generated explanations show competitive BLEU scores against groundtruth explanations, they fail to improve prediction performance. We further show that generated explanations often hallucinate information and miss key elements that indicate the label.


RapidAI4EO A Corpus for Higher Spatial and Temporal Reasoning. Under the sponsorship of the European Union Horizon 2020 program, RapidAI4EO will establish the foundations for the next generation of Copernicus Land Monitoring Service (CLMS) products. The project aims to provide intensified monitoring of Land Use (LU), Land Cover (LC), and LU change at a much higher level of detail and temporal cadence than it is possible today. Focus is on disentangling phenology from structural change and in providing critical training data to drive advancement in the Copernicus community and ecosystem well beyond the lifetime of this project. To this end we are creating the densest spatiotemporal training sets ever by fusing open satellite data with Planet imagery at as many as 500,000 patch locations over Europe and delivering high resolution daily time series at all locations. We plan to open source these datasets for the benefit of the entire remote sensing community.


Automorphisms and isogeny graphs of abelian varieties, with applications to the superspecial Richelot isogeny graph. We investigate special structures due to automorphisms in isogeny graphs of principally polarized abelian varieties, and abelian surfaces in particular. We give theoretical and experimental results on the spectral and statistical properties of (2, 2) isogeny graphs of superspecial abelian surfaces, including stationary distributions for random walks, bounds on eigenvalues and diameters, and a proof of the connectivity of the Jacobian subgraph of the (2, 2) isogeny graph. Our results improve our understanding of the performance and security of some recently proposed cryptosystems, and are also a concrete step towards a better understanding of general superspecial isogeny graphs in arbitrary dimension.


An Efficient Indexing and Searching Technique for Information Retrieval for Urdu Language. Indexing techniques are used to improve retrieval of data in response to certain search condition. Inverted files are mostly used for creating indexes. This paper proposes indexing technique for Urdu language. Language processing step in Index creation is different for a particular language. We discuss index creation steps specifically for Urdu language. We explore morphological rules for Urdu language and implement these rules to create Urdu stemmer. We implement our proposed technique with different implementations and compare results. We suggest that indexes should be created without stop words and also index file should be an order index file.


Fast mixing via polymers for random graphs with unbounded degree. The polymer model framework is a classical tool from statistical mechanics that has recently been used to obtain approximation algorithms for spin systems on classes of bounded degree graphs examples include the ferromagnetic Potts model on expanders and on the grid. One of the key ingredients in the analysis of polymer models is controlling the growth rate of the number of polymers, which has been typically achieved so far by invoking the bounded degree assumption. Nevertheless, this assumption is often restrictive and obstructs the applicability of the method to more general graphs. For example, sparse random graphs typically have bounded average degree and good expansion properties, but they include vertices with unbounded degree, and therefore are excluded from the current polymer model framework. We develop a less restrictive framework for polymer models that relaxes the standard bounded degree assumption, by reworking the relevant polymer models from the edge perspective. The edge perspective allows us to bound the growth rate of the number of polymers in terms of the total degree of polymers, which in turn can be related more easily to the expansion properties of the underlying graph. To apply our methods, we consider random graphs with unbounded degrees from a fixed degree sequence (with minimum degree at least 3) and obtain approximation algorithms for the ferromagnetic Potts model, which is a standard benchmark for polymer models. Our techniques also extend to more general spin systems.


A variational proof of a disentanglement theorem for multilinear norm inequalities. In 1 and 2 we developed a duality theory for multilinear norm inequalities. This duality theory is underpinned by a disentanglement theorem, which states that estimates on a weighted geometric mean over (convex) families of functions can be disentangled into quantitatively linked estimates on each family separately. The disentanglement theorem was proved in 1 via minimax theory together with weak compactness arguments in the space of finitely additive measures, and an application of the Yosida Hewitt theory of such measures. In this paper we provide an alternate, rather elementary approach to the disentanglement theorem we first prove a finite dimensional case via perturbation and strong compactness, and then, building on that, the general infinite dimensional case via the finite intersection property and weak compactness.


Cardinal characteristics on kappa modulo non stationary. For kappa regular and uncountable we define variants of the classical cardinal characteristics modulo the non stationary ideal.


Splitting Spanner Atoms A Tool for Acyclic Core Spanners. This paper investigates regex CQs with string equalities (SERCQs), a subclass of core spanners. As shown by Freydenberger, Kimelfeld, and Peterfreund (PODS 2018), these queries are intractable, even if restricted to acyclic queries. This previous result defines acyclicity by treating regex formulas as atoms. In contrast to this, we propose an alternative definition by converting SERCQs into FC CQs conjunctive queries in FC, a logic that is based on word equations. We introduce a way to decompose word equations of unbounded arity into a conjunction of binary word equations. If the result of the decomposition is acyclic, then evaluation and enumeration of results become tractable. The main result of this work is an algorithm that decides in polynomial time whether an FC CQ can be decomposed into an acyclic FC CQ. We also give an efficient conversion from synchronized SERCQs to FC CQs with regular constraints. As a consequence, tractability results for acyclic relational CQs directly translate to a large class of SERCQs.


Compression for 2 Parameter Persistent Homology. Compression aims to reduce the size of an input, while maintaining its relevant properties. For multi parameter persistent homology, compression is a necessary step in any computational pipeline, since standard constructions lead to large inputs, and computational tasks in this area tend to be expensive. We propose two compression methods for chain complexes of free 2 parameter persistence modules. The first method extends the multi chunk algorithm for one parameter persistent homology, returning the smallest chain complex among all the ones quasi isomorphic to the input. The second method produces minimal presentations of the homology of the input it is based on an algorithm of Lesnick and Wright, but incorporates several improvements that lead to dramatic performance gains. The two methods are complementary, and can be combined to compute minimal presentations for complexes with millions of generators in a few seconds. The methods have been implemented, and the software is publicly available. We report on experimental evaluations, which demonstrate substantial improvements in performance compared to previously available compression strategies.


A Cahn Hilliard multiphase system with mobilities for the simulation of wetting. This paper tackles the simulation of the wetting phenomenon using a phase field model. To this end, we extend to multiphase the Cahn Hilliard model with doubly degenerate mobilities we introduced in 17 and we show that this extension still preserves the second order of approximation of the sharp limit. In a second part, we propose a simple and efficient numerical schemes that require only about 60 lines in Matlab. We then provide some numerical experiments illustrating the influence of mobility and surface tension coefficients. Finally, we explain how to apply our phase field model to approximate the wetting of a thin tube on different solid supports.


Dual SDDP for risk averse multistage stochastic programs. Risk averse multistage stochastic programs appear in multiple areas and are challenging to solve. Stochastic Dual Dynamic Programming (SDDP) is a well known tool to address such problems under time independence assumptions. We show how to derive a dual formulation for these problems and apply an SDDP algorithm, leading to converging and deterministic upper bounds for risk averse problems.


Flagellar length control in multiflagellated eukaryotes a case study with Giardia. Every organism has a size that is convenient for its function. Not only multicellular organisms but also uni cellular organisms and even subcellular structures have convenient sizes. Flagella of eukaryotic cells are long dynamic cell protrusions. Because of their simple linear geometry, these cell appendages have been popular system for experimental investigation of the mechanisms of size control of organelles of eukaryotic cells. In the past most of the attention have been focussed on mono flagellates and bi flagellates. By extending our earlier model of bi flagellates, here we develop a theoretical model for flagellar length control in it Giardia which is an octo flagellate. It has four pairs of flagella of four different lengths. Analyzing our model we predict the different sizes of the four pairs of flagella . This analysis not only provide insight into the physical origins of the different lengths but the predicted lengths are also consistent with the experimental data.


BossNAS Exploring Hybrid CNN transformers with Block wisely Self supervised Neural Architecture Search. A myriad of recent breakthroughs in hand crafted neural architectures for visual recognition have highlighted the urgent need to explore hybrid architectures consisting of diversified building blocks. Meanwhile, neural architecture search methods are surging with an expectation to reduce human efforts. However, whether NAS methods can efficiently and effectively handle diversified search spaces with disparate candidates (e.g. CNNs and transformers) is still an open question. In this work, we present Block wisely Self supervised Neural Architecture Search (BossNAS), an unsupervised NAS method that addresses the problem of inaccurate architecture rating caused by large weight sharing space and biased supervision in previous methods. More specifically, we factorize the search space into blocks and utilize a novel self supervised training scheme, named ensemble bootstrapping, to train each block separately before searching them as a whole towards the population center. Additionally, we present HyTra search space, a fabric like hybrid CNN transformer search space with searchable down sampling positions. On this challenging search space, our searched model, BossNet T, achieves up to 82.5 accuracy on ImageNet, surpassing EfficientNet by 2.4 with comparable compute time. Moreover, our method achieves superior architecture rating accuracy with 0.78 and 0.76 Spearman correlation on the canonical MBConv search space with ImageNet and on NATS Bench size search space with CIFAR 100, respectively, surpassing state of the art NAS methods. Code https github.com changlin31 BossNAS


High Resolution Image Harmonization via Collaborative Dual Transformations. Given a composite image, image harmonization aims to adjust the foreground to make it compatible with the background. High resolution image harmonization is in high demand, but still remains unexplored. Conventional image harmonization methods learn global RGB to RGB transformation which could effortlessly scale to high resolution, but ignore diverse local context. Recent deep learning methods learn the dense pixel to pixel transformation which could generate harmonious outputs, but are highly constrained in low resolution. In this work, we propose a high resolution image harmonization network with Collaborative Dual Transformation (CDTNet) to combine pixel to pixel transformation and RGB to RGB transformation coherently in an end to end network. Our CDTNet consists of a low resolution generator for pixel to pixel transformation, a color mapping module for RGB to RGB transformation, and a refinement module to take advantage of both. Extensive experiments on high resolution benchmark dataset and our created high resolution real composite images demonstrate that our CDTNet strikes a good balance between efficiency and effectiveness. Our used datasets can be found in https github.com bcmi CDTNet High Resolution Image Harmonization.


Lax Oleinik type formulas and efficient algorithms for certain high dimensional optimal control problems. We provide analytical solutions to certain optimal control problems whose running cost depends on the state variable and with constraints on the control. We also provide Lax Oleinik type representation formulas for the corresponding Hamilton Jacobi partial differential equations with state dependent Hamiltonians. Additionally, we present efficient, grid free numerical solvers based on our representation formulas, which are shown, in some cases, to scale linearly with the state dimension, and thus, to overcome the curse of dimensionality. Using existing optimization methods and the min plus technique, we extend our numerical solvers to address more general classes of convex and nonconvex initial costs. As a result, our numerical methods have the potential to serve as a building block for solving broader classes of high dimensional optimal control problems in real time.


A New Method of Construction of Permutation Trinomials with Coefficients 1. Permutation polynomials over finite fields are an interesting and constantly active research subject of study for many years. They have important applications in areas of mathematics and engineering. In recent years, permutation binomials and permutation trinomials attract people's interests due to their simple algebraic forms. In this paper, by reversely using Tu's method for the characterization of permutation polynomials with exponents of Niho type, we propose a new method to construct permutation trinomials with coefficients 1. Moreover, we give the explicit compositional inverses of a class of permutation trinomials for a special case.


What goes on inside rumour and non rumour tweets and their reactions A Psycholinguistic Analyses. In recent years, the problem of rumours on online social media (OSM) has attracted lots of attention. Researchers have started investigating from two main directions. First is the descriptive analysis of rumours and secondly, proposing techniques to detect (or classify) rumours. In the descriptive line of works, where researchers have tried to analyse rumours using NLP approaches, there isnt much emphasis on psycho linguistics analyses of social media text. These kinds of analyses on rumour case studies are vital for drawing meaningful conclusions to mitigate misinformation. For our analysis, we explored the PHEME9 rumour dataset (consisting of 9 events), including source tweets (both rumour and non rumour categories) and response tweets. We compared the rumour and nonrumour source tweets and then their corresponding reply (response) tweets to understand how they differ linguistically for every incident. Furthermore, we also evaluated if these features can be used for classifying rumour vs. non rumour tweets through machine learning models. To this end, we employed various classical and ensemble based approaches. To filter out the highly discriminative psycholinguistic features, we explored the SHAP AI Explainability tool. To summarise, this research contributes by performing an in depth psycholinguistic analysis of rumours related to various kinds of events.


Internal Smith Purcell radiation and its interplay with Cherenkov diffraction radiation in silicon a combined time and frequency domain numerical study. We consider radiation generated by an electron travelling parallel to a planar rectangular silicon grating Smith Purcell radiation to the vacuum side, internal Smith Purcell radiation into the dielectric, and Cherenkov radiation into the dielectric. Internal Smith Purcell radiation dominates over the other two radiation mechanisms in the range where conventional Smith Purcell radiation is forbidden. This observation may lead to improved design of contactless particle beam monitors.


Out of Distribution Detection of Melanoma using Normalizing Flows. Generative modelling has been a topic at the forefront of machine learning research for a substantial amount of time. With the recent success in the field of machine learning, especially in deep learning, there has been an increased interest in explainable and interpretable machine learning. The ability to model distributions and provide insight in the density estimation and exact data likelihood is an example of such a feature. Normalizing Flows (NFs), a relatively new research field of generative modelling, has received substantial attention since it is able to do exactly this at a relatively low cost whilst enabling competitive generative results. While the generative abilities of NFs are typically explored, we focus on exploring the data distribution modelling for Out of Distribution (OOD) detection. Using one of the state of the art NF models, GLOW, we attempt to detect OOD examples in the ISIC dataset. We notice that this model under performs in conform related research. To improve the OOD detection, we explore the masking methods to inhibit co adaptation of the coupling layers however find no substantial improvement. Furthermore, we utilize Wavelet Flow which uses wavelets that can filter particular frequency components, thus simplifying the modeling process to data driven conditional wavelet coefficients instead of complete images. This enables us to efficiently model larger resolution images in the hopes that it would capture more relevant features for OOD. The paper that introduced Wavelet Flow mainly focuses on its ability of sampling high resolution images and did not treat OOD detection. We present the results and propose several ideas for improvement such as controlling frequency components, using different wavelets and using other state of the art NF architectures.


Correctable Erasure Patterns in Product Topologies. Locality enables storage systems to recover failed nodes from small subsets of surviving nodes. The setting where nodes are partitioned into subsets, each allowing for local recovery, is well understood. In this work we consider a generalization introduced by Gopalan et al., where, viewing the codewords as arrays, constraints are imposed on the columns and rows in addition to some global constraints. Specifically, we present a generic method of adding such global parity checks and derive new results on the set of correctable erasure patterns. Finally, we relate the set of correctable erasure patterns in the considered topology to those correctable in tensor product codes.


Investigating Neighborhood Modeling and Asymmetry Preservation in Digraph Representation Learning. Graph Neural Networks (GNNs) traditionally exhibit poor performance for directed graphs (digraphs) due to notable challenges in 1) modeling neighborhoods and 2) preserving asymmetry. In this paper, we address these challenges in traditional GNNs by leveraging hyperbolic collaborative learning from multi ordered and partitioned neighborhoods, and regularizers inspired by socio psychological factors. Our resulting formalism, Digraph Hyperbolic Network (D HYPR) learns node representations in hyperbolic space to avoid structural and semantic distortion of real world digraphs. We conduct comprehensive experimentation on 4 tasks link prediction, node classification, sign prediction, and embedding visualization. D HYPR statistically significantly outperforms the current state of the art on a majority of tasks and datasets, while achieving competitive performance otherwise. Our code and data will be available.


Cyclic Lattices, Ideal Lattices and Bounds for the Smoothing Parameter. Cyclic lattices and ideal lattices were introduced by Micciancio in cite D2 , Lyubashevsky and Micciancio in cite L1 respectively, which play an efficient role in Ajtai's construction of a collision resistant Hash function (see cite M1 and cite M2 ) and in Gentry's construction of fully homomorphic encryption (see cite G ). Let R Z x langle phi(x) rangle be a quotient ring of the integer coefficients polynomials ring, Lyubashevsky and Micciancio regarded an ideal lattice as the correspondence of an ideal of R , but they neither explain how to extend this definition to whole Euclidean space mathbb R n , nor exhibit the relationship of cyclic lattices and ideal lattices. In this paper, we regard the cyclic lattices and ideal lattices as the correspondences of finitely generated R modules, so that we may show that ideal lattices are actually a special subclass of cyclic lattices, namely, cyclic integer lattices. In fact, there is a one to one correspondence between cyclic lattices in mathbb R n and finitely generated R modules (see Theorem ref th4 below). On the other hand, since R is a Noether ring, each ideal of R is a finitely generated R module, so it is natural and reasonable to regard ideal lattices as a special subclass of cyclic lattices (see corollary ref co3.4 below). It is worth noting that we use more general rotation matrix here, so our definition and results on cyclic lattices and ideal lattices are more general forms. As application, we provide cyclic lattice with an explicit and countable upper bound for the smoothing parameter (see Theorem ref th5 below). It is an open problem that is the shortest vector problem on cyclic lattice NP hard? (see cite D2 ). Our results may be viewed as a substantial progress in this direction.


Grazing incidence X ray fluorescence based characterization of nanostructures for element sensitive profile reconstruction. For the reliable fabrication of the current and next generation of nanostructures it is essential to be able to determine their material composition and dimensional parameters. Using the grazing incidence X ray fluoresence technique, which is taking advantage of the X ray standing wave field effect, nanostructures can be investigated with a high sensitivity with respect to the structural and elemental composition. This is demonstrated using lamellar gratings made of Si 3 N 4 . Rigorous field simulations obtained from a Maxwell solver based on the finite element method allow to determine the spatial distribution of elemental species and the geometrical shape with sub nm resolution. The increasing complexity of nanostructures and demanded sensitivity for small changes quickly turn the curse of dimensionality for numerical simulation into a problem which can no longer be solved rationally even with massive parallelisation. New optimization schemes, e.g. machine learning, are required to satisfy the metrological requirements. We present reconstruction results obtained with a Bayesian optimization approach to reduce the computational effort.


Weakly Supervised Instance Segmentation for Videos with Temporal Mask Consistency. Weakly supervised instance segmentation reduces the cost of annotations required to train models. However, existing approaches which rely only on image level class labels predominantly suffer from errors due to (a) partial segmentation of objects and (b) missing object predictions. We show that these issues can be better addressed by training with weakly labeled videos instead of images. In videos, motion and temporal consistency of predictions across frames provide complementary signals which can help segmentation. We are the first to explore the use of these video signals to tackle weakly supervised instance segmentation. We propose two ways to leverage this information in our model. First, we adapt inter pixel relation network (IRN) to effectively incorporate motion information during training. Second, we introduce a new MaskConsist module, which addresses the problem of missing object instances by transferring stable predictions between neighboring frames during training. We demonstrate that both approaches together improve the instance segmentation metric AP 50 on video frames of two datasets Youtube VIS and Cityscapes by 5 and 3 respectively.


Broadcast Rate Requires Nonlinear Coding in a Unicast Index Coding Instance of Size 36. Insufficiency of linear coding for the network coding problem was first proved by providing an instance which is solvable only by nonlinear network coding (Dougherty et al., 2005).Based on the work of Effros, et al., 2015, this specific network coding instance can be modeled as a groupcast index coding (GIC)instance with 74 messages and 80 users (where a message can be requested by multiple users). This proves the insufficiency of linear coding for the GIC problem. Using the systematic approach proposed by Maleki et al., 2014, the aforementioned GIC instance can be cast into a unicast index coding (UIC) instance with more than 200 users, each wanting a unique message. This confirms the necessity of nonlinear coding for the UIC problem, but only for achieving the entire capacity region. Nevertheless, the question of whether nonlinear coding is required to achieve the symmetric capacity (broadcast rate) of the UIC problem remained open. In this paper, we settle this question and prove the insufficiency of linear coding, by directly building a UIC instance with only 36users for which there exists a nonlinear index code outperforming the optimal linear code in terms of the broadcast rate.


WIP Exploring DSME MAC for LoRa A System Integration and First Evaluation. LoRa is a popular wireless technology that enables low throughput (bytes) long range communication (km) at low energy consumption (mW). Its transmission, though, is on one side prone to interference during long on air times, and on the other side subject to duty cycle restrictions. LoRaWAN defines a MAC and a vertical stack on top of LoRa. LoRaWAN circumvents the above limitations by imposing a centralized network architecture, which heavily reduces downlink capacity and prevents peer to peer communication. This makes it unusable for many deployments. The Deterministic and Synchronous Multichannel Extension (DSME) of IEEE 802.15.4e benefits of time slotted communication and peer to peer communication and has the potential to overcome LoRaWAN limitations. In this work, we implement DSME on top of LoRa in the open source IoT OS RIOT and open the field for first evaluation experiments on real hardware. Initial results indicate that DSME LoRa not only enables reliable peer to peer communication for constrained IoT devices, but also scales with an increasing number of nodes.


Aggregation sheaves for greedy modal decompositions. This article develops a new theoretical basis for decomposing signals that are formed by the linear superposition of a finite number of modes. Each mode depends nonlinearly upon several parameters we seek both these parameters and the weights within the superposition. The particular focus of this article is upon solving the decomposition problem when the number of modes is not known in advance. A sheaf theoretic formalism is introduced that describes all modal decomposition problems, and it is shown that minimizing the local consistency radius within this sheaf is guaranteed to solve them. Since the modes may or may not be well separated, a greedy algorithm that identifies the most distinct modes first may not work reliably. This article introduces a novel mathematical formalism, aggregation sheaves, and shows how they characterize the behavior of greedy algorithms that attempt to solve modal decomposition problems.


Underwater Image Enhancement via Medium Transmission Guided Multi Color Space Embedding. Underwater images suffer from color casts and low contrast due to wavelength and distance dependent attenuation and scattering. To solve these two degradation issues, we present an underwater image enhancement network via medium transmission guided multi color space embedding, called Ucolor. Concretely, we first propose a multi color space encoder network, which enriches the diversity of feature representations by incorporating the characteristics of different color spaces into a unified structure. Coupled with an attention mechanism, the most discriminative features extracted from multiple color spaces are adaptively integrated and highlighted. Inspired by underwater imaging physical models, we design a medium transmission (indicating the percentage of the scene radiance reaching the camera) guided decoder network to enhance the response of the network towards quality degraded regions. As a result, our network can effectively improve the visual quality of underwater images by exploiting multiple color spaces embedding and the advantages of both physical model based and learning based methods. Extensive experiments demonstrate that our Ucolor achieves superior performance against state of the art methods in terms of both visual quality and quantitative metrics.


Strong Szeg H o theorem on a Jordan curve. We consider certain determinants with respect to a sufficiently regular Jordan curve gamma in the complex plane that generalize Toeplitz determinants which are obtained when the curve is the circle. This also corresponds to studying a planar Coulomb gas on the curve at inverse temperature beta 2 . Under suitable assumptions on the curve we prove a strong Szeg H o type asymptotic formula as the size of the determinant grows. The resulting formula involves the Grunsky operator built from the Grunsky coefficients of the exterior mapping function for gamma . As a consequence of our formula we obtain the asymptotics of the partition function for the Coulomb gas on the curve. This formula involves the Fredholm determinant of the absolute value squared of the Grunsky operator which equals, up to a multiplicative constant, the Loewner energy of the curve. Based on this we obtain a new characterization of curves with finite Loewner energy called Weil Petersson quasicircles.


SHACL A Description Logic in Disguise. SHACL is a W3C proposed language for expressing structural constraints on RDF graphs. In recent years, SHACL's popularity has risen quickly. This rise in popularity comes with questions related to its place in the semantic web, particularly about its relation to OWL (the de facto standard for expressing ontological information on the web) and description logics (which form the formal foundations of OWL). We answer these questions by arguing that SHACL is in fact a description logic. On the one hand, our answer is surprisingly simple, some might even say obvious. But, on the hand, our answer is also controversial. By resolving this issue once and for all, we establish the field of description logics as the solid formal foundations of SHACL.


Grid Partitioned Attention Efficient TransformerApproximation with Inductive Bias for High Resolution Detail Generation. Attention is a general reasoning mechanism than can flexibly deal with image information, but its memory requirements had made it so far impractical for high resolution image generation. We present Grid Partitioned Attention (GPA), a new approximate attention algorithm that leverages a sparse inductive bias for higher computational and memory efficiency in image domains queries attend only to few keys, spatially close queries attend to close keys due to correlations. Our paper introduces the new attention layer, analyzes its complexity and how the trade off between memory usage and model power can be tuned by the hyper parameters.We will show how such attention enables novel deep learning architectures with copying modules that are especially useful for conditional image generation tasks like pose morphing. Our contributions are (i) algorithm and code1of the novel GPA layer, (ii) a novel deep attention copying architecture, and (iii) new state of the art experimental results in human pose morphing generation benchmarks.


Multi Sample based Contrastive Loss for Top k Recommendation. The top k recommendation is a fundamental task in recommendation systems which is generally learned by comparing positive and negative pairs. The Contrastive Loss (CL) is the key in contrastive learning that has received more attention recently and we find it is well suited for top k recommendations. However, it is a problem that CL treats the importance of the positive and negative samples as the same. On the one hand, CL faces the imbalance problem of one positive sample and many negative samples. On the other hand, positive items are so few in sparser datasets that their importance should be emphasized. Moreover, the other important issue is that the sparse positive items are still not sufficiently utilized in recommendations. So we propose a new data augmentation method by using multiple positive items (or samples) simultaneously with the CL loss function. Therefore, we propose a Multi Sample based Contrastive Loss (MSCL) function which solves the two problems by balancing the importance of positive and negative samples and data augmentation. And based on the graph convolution network (GCN) method, experimental results demonstrate the state of the art performance of MSCL. The proposed MSCL is simple and can be applied in many methods. We will release our code on GitHub upon the acceptance.


From Teaching to Coaching A Case Study of a Technical Communication Course. One of the leading university goals is to provide the students with the necessary skills for better functioning in their future studies. Gaining and developing skills, both technical and soft skills, are the critical building blocks for a successful career. The traditional teaching process, which includes delivering lectures and conducting exams, emphasizes the upliftment of technical knowledge rather than building self esteem and enhancing skills development among students. Development of non technical skills like self esteem, life long learning among students is vital for a successful career. This paper targets to achieve the objective of identifying ways to empower students with non technical skills along with technical skills. The approach adopted in this research work is to transform the delivery of a faculty wide course from teaching to coaching. One salient difference between teaching and coaching is to move students motivation away from grades towards life long learning. Thus, university students maximize skills through coaching like course structure, course delivery, course assessment, and student involvement. As a case study, the proposed approach was successfully tested and validated on a course taught in the Faculty of Computing and Information Technology (FCIT) at King Abdulaziz University (KAU). The outcome of this case study reveals that there is substantial potential towards enhancement of self responsibility. In the future, this approach can be extended for other courses that aim to develop skills such as English language courses, computer, and communication skills courses in the preparatory foundation year.


Schur analysis and discrete analytic functions Rational functions and co isometric realizations. We define and study rational discrete analytic functions and prove the existence of a coisometric realization for discrete analytic Schur multipliers.


Identifying vital nodes by Achlioptas process. The vital nodes are the ones that play an important role in the organization of network structure or the dynamical behaviours of networked systems. Previous studies usually applied the node centralities to quantify the importance of nodes. Realizing that the percolation clusters are dominated by local connections in the subcritical phase and by global connections in the supercritical phase, in this paper we propose a new method to identify the vital nodes via a competitive percolation process that is based on an Achlioptas process. Compared with the existing node centrality indices, the new method performs overall better in identifying the vital nodes that maintain network connectivity and facilitate network synchronization when considering different network structure characteristics, such as link density, degree distribution, assortativity, and clustering. We also find that our method is more tolerant of noisy data and missing data. More importantly, compared with the unique ranking list of nodes given by most centrality methods, the randomness of the percolation process expands the possibility space of the optimal solutions, which is of great significance in practical applications.


Understanding collective human movement dynamics during large scale events using big geosocial data analytics. With the rapid advancement of information and communication technologies, many researchers have adopted alternative data sources from private data vendors to study human movement dynamics in response to large scale natural or societal events. Big geosocial data such as georeferenced tweets are publicly available and dynamically evolving as real world events are happening, making it more likely to capture the real time sentiments and responses of populations. However, precisely geolocated geosocial data is scarce and biased toward urban population centers. In this research, we developed a big geosocial data analytical framework for extracting human movement dynamics in response to large scale events from publicly available georeferenced tweets. The framework includes a two stage data collection module that collects data in a more targeted fashion in order to mitigate the data scarcity issue of georeferenced tweets in addition, a variable bandwidth kernel density estimation(VB KDE) approach was adopted to fuse georeference information at different spatial scales, further augmenting the signals of human movement dynamics contained in georeferenced tweets. To correct for the sampling bias of georeferenced tweets, we adjusted the number of tweets for different spatial units (e.g., county, state) by population. To demonstrate the performance of the proposed analytic framework, we chose an astronomical event that occurred nationwide across the United States, i.e., the 2017 Great American Eclipse, as an example event and studied the human movement dynamics in response to this event. However, this analytic framework can easily be applied to other types of large scale events such as hurricanes or earthquakes.